Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-09-28T07:55:25Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-09-28T07:55:25Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task47VKlj/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task47VKlj/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/security.properties
2026-09-28 07:55:33: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task47VKlj/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task47VKlj/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260928 07:55:42.367791 27511 external_mini_cluster.cc:1372] Running /tmp/dist-test-task47VKlj/build/tsan/bin/kudu
/tmp/dist-test-task47VKlj/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.221.254:36357
--webserver_interface=127.26.221.254
--webserver_port=0
--builtin_ntp_servers=127.26.221.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--hive_metastore_uris=thrift://127.0.0.1:33315
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 07:55:42.682718 27796 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 07:55:42.683377 27796 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 07:55:42.683826 27796 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 07:55:42.717576 27796 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 07:55:42.717952 27796 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 07:55:42.718235 27796 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 07:55:42.718495 27796 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 07:55:42.756119 27796 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.221.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:33315
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.221.254:36357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.221.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 07:43:23 UTC on e7f111948823
build id 14038
TSAN enabled
I20260928 07:55:42.757661 27796 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 07:55:42.759403 27796 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 07:55:42.771626 27802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:42.771633 27803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:44.176373 27801 debug-util.cc:398] Leaking SignalData structure 0x7b08000292c0 after lost signal to thread 27796
W20260928 07:55:44.280462 27796 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.509s user 0.512s sys 0.992s
W20260928 07:55:44.281836 27796 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.511s user 0.513s sys 0.992s
W20260928 07:55:44.282403 27804 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1509 milliseconds
W20260928 07:55:44.283423 27805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 07:55:44.283350 27796 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 07:55:44.287161 27796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 07:55:44.289784 27796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 07:55:44.291198 27796 hybrid_clock.cc:648] HybridClock initialized: now 1790582144291156 us; error 53 us; skew 500 ppm
I20260928 07:55:44.292064 27796 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 07:55:44.298416 27796 webserver.cc:533] Webserver started at http://127.26.221.254:34467/ using document root <none> and password file <none>
I20260928 07:55:44.299409 27796 fs_manager.cc:362] Metadata directory not provided
I20260928 07:55:44.299640 27796 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 07:55:44.300110 27796 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 07:55:44.304536 27796 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/data/instance:
uuid: "dfb6604d9ebb423090c878c2b1db0cab"
format_stamp: "Formatted at 2026-09-28 07:55:44 on dist-test-slave-mf55"
I20260928 07:55:44.305804 27796 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/wal/instance:
uuid: "dfb6604d9ebb423090c878c2b1db0cab"
format_stamp: "Formatted at 2026-09-28 07:55:44 on dist-test-slave-mf55"
I20260928 07:55:44.313711 27796 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260928 07:55:44.319851 27812 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:44.321108 27796 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.003s
I20260928 07:55:44.321708 27796 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/data,/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/wal
uuid: "dfb6604d9ebb423090c878c2b1db0cab"
format_stamp: "Formatted at 2026-09-28 07:55:44 on dist-test-slave-mf55"
I20260928 07:55:44.322079 27796 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 07:55:44.377764 27796 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 07:55:44.379500 27796 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 07:55:44.380015 27796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 07:55:44.461040 27796 rpc_server.cc:307] RPC server started. Bound to: 127.26.221.254:36357
I20260928 07:55:44.461151 27863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.221.254:36357 every 8 connection(s)
I20260928 07:55:44.463953 27796 server_base.cc:1193] Dumped server information to /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/data/info.pb
I20260928 07:55:44.470404 27864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:44.471781 27511 external_mini_cluster.cc:1434] Started /tmp/dist-test-task47VKlj/build/tsan/bin/kudu as pid 27796
I20260928 07:55:44.472251 27511 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-0/wal/instance
I20260928 07:55:44.476090 27511 external_mini_cluster.cc:1372] Running /tmp/dist-test-task47VKlj/build/tsan/bin/kudu
/tmp/dist-test-task47VKlj/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.221.253:45305
--webserver_interface=127.26.221.253
--webserver_port=0
--builtin_ntp_servers=127.26.221.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--hive_metastore_uris=thrift://127.0.0.1:33315
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 07:55:44.481751 27864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } has no permanent_uuid. Determining permanent_uuid...
I20260928 07:55:44.514272 27864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } has no permanent_uuid. Determining permanent_uuid...
W20260928 07:55:44.517050 27813 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.253:45305: connect: Connection refused (error 111)
W20260928 07:55:44.522225 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.253:45305: Network error: Client connection negotiation failed: client connection to 127.26.221.253:45305: connect: Connection refused (error 111)
I20260928 07:55:44.571861 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } attempt: 1
W20260928 07:55:44.576941 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.253:45305: Network error: Client connection negotiation failed: client connection to 127.26.221.253:45305: connect: Connection refused (error 111)
I20260928 07:55:44.645519 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } attempt: 2
W20260928 07:55:44.650535 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.253:45305: Network error: Client connection negotiation failed: client connection to 127.26.221.253:45305: connect: Connection refused (error 111)
I20260928 07:55:44.742045 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } attempt: 3
W20260928 07:55:44.752753 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.253:45305: Network error: Client connection negotiation failed: client connection to 127.26.221.253:45305: connect: Connection refused (error 111)
W20260928 07:55:44.807240 27865 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 07:55:44.807824 27865 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 07:55:44.808218 27865 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 07:55:44.841681 27865 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 07:55:44.841984 27865 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 07:55:44.842198 27865 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 07:55:44.842406 27865 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 07:55:44.880573 27865 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.221.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:33315
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.221.253:45305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.221.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 07:43:23 UTC on e7f111948823
build id 14038
TSAN enabled
I20260928 07:55:44.882058 27865 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 07:55:44.883777 27865 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 07:55:44.896165 27874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 07:55:44.896209 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } attempt: 4
W20260928 07:55:44.904052 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.253:45305: Network error: Client connection negotiation failed: client connection to 127.26.221.253:45305: connect: Connection refused (error 111)
I20260928 07:55:45.203634 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } attempt: 5
W20260928 07:55:45.212693 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.253:45305: Network error: Client connection negotiation failed: client connection to 127.26.221.253:45305: connect: Connection refused (error 111)
I20260928 07:55:45.760335 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } attempt: 6
W20260928 07:55:45.806953 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.253:45305: Network error: Client connection negotiation failed: client connection to 127.26.221.253:45305: connect: Connection refused (error 111)
W20260928 07:55:44.898427 27875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:46.196988 27876 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1297 milliseconds
W20260928 07:55:46.197665 27877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:46.200259 27865 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.304s user 0.425s sys 0.873s
W20260928 07:55:46.200555 27865 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.304s user 0.425s sys 0.873s
I20260928 07:55:46.200855 27865 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 07:55:46.203958 27865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 07:55:46.207028 27865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 07:55:46.208554 27865 hybrid_clock.cc:648] HybridClock initialized: now 1790582146208480 us; error 89 us; skew 500 ppm
I20260928 07:55:46.209522 27865 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 07:55:46.217357 27865 webserver.cc:533] Webserver started at http://127.26.221.253:43003/ using document root <none> and password file <none>
I20260928 07:55:46.218394 27865 fs_manager.cc:362] Metadata directory not provided
I20260928 07:55:46.218639 27865 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 07:55:46.219189 27865 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 07:55:46.223800 27865 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/data/instance:
uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
format_stamp: "Formatted at 2026-09-28 07:55:46 on dist-test-slave-mf55"
I20260928 07:55:46.225016 27865 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/wal/instance:
uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
format_stamp: "Formatted at 2026-09-28 07:55:46 on dist-test-slave-mf55"
I20260928 07:55:46.234305 27865 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.007s sys 0.000s
I20260928 07:55:46.241807 27887 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:46.243444 27865 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260928 07:55:46.243854 27865 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/data,/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/wal
uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
format_stamp: "Formatted at 2026-09-28 07:55:46 on dist-test-slave-mf55"
I20260928 07:55:46.244282 27865 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 07:55:46.320597 27865 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 07:55:46.322299 27865 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 07:55:46.322788 27865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 07:55:46.399636 27865 rpc_server.cc:307] RPC server started. Bound to: 127.26.221.253:45305
I20260928 07:55:46.399739 27938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.221.253:45305 every 8 connection(s)
I20260928 07:55:46.402534 27865 server_base.cc:1193] Dumped server information to /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/data/info.pb
I20260928 07:55:46.403523 27511 external_mini_cluster.cc:1434] Started /tmp/dist-test-task47VKlj/build/tsan/bin/kudu as pid 27865
I20260928 07:55:46.404273 27511 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-1/wal/instance
I20260928 07:55:46.407054 27511 external_mini_cluster.cc:1372] Running /tmp/dist-test-task47VKlj/build/tsan/bin/kudu
/tmp/dist-test-task47VKlj/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.221.252:41205
--webserver_interface=127.26.221.252
--webserver_port=0
--builtin_ntp_servers=127.26.221.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--hive_metastore_uris=thrift://127.0.0.1:33315
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 07:55:46.409165 27939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:46.420403 27939 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } has no permanent_uuid. Determining permanent_uuid...
I20260928 07:55:46.449601 27939 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } has no permanent_uuid. Determining permanent_uuid...
I20260928 07:55:46.468016 27939 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } has no permanent_uuid. Determining permanent_uuid...
W20260928 07:55:46.471773 27891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:55:46.477130 27939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:46.526765 27939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 1
W20260928 07:55:46.531417 27939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:46.599895 27939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 2
W20260928 07:55:46.604597 27939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:46.696102 27939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 3
W20260928 07:55:46.702724 27939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:55:46.757560 27940 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 07:55:46.758215 27940 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 07:55:46.758685 27940 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 07:55:46.794983 27940 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 07:55:46.795356 27940 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 07:55:46.795635 27940 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 07:55:46.795955 27940 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 07:55:46.836681 27940 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.221.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:33315
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.221.252:41205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.221.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 07:43:23 UTC on e7f111948823
build id 14038
TSAN enabled
I20260928 07:55:46.838279 27940 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 07:55:46.840016 27940 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260928 07:55:46.846242 27939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 4
W20260928 07:55:46.852514 27950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:46.852988 27939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:46.867630 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } attempt: 7
I20260928 07:55:46.881543 27864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } has no permanent_uuid. Determining permanent_uuid...
W20260928 07:55:46.887877 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:46.946383 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 1
W20260928 07:55:46.950955 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:47.032456 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 2
W20260928 07:55:47.040163 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:47.125782 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 3
W20260928 07:55:47.133396 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:47.152532 27939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 5
W20260928 07:55:47.160301 27939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:47.274005 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 4
W20260928 07:55:47.282133 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:47.565762 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 5
W20260928 07:55:47.573608 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:47.707907 27939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 6
W20260928 07:55:47.722738 27939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:48.126190 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 6
W20260928 07:55:48.136473 27864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.221.252:41205: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:55:46.853929 27951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:46.860872 27953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:48.222954 27952 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1367 milliseconds
I20260928 07:55:48.223137 27940 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 07:55:48.224562 27940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 07:55:48.227349 27940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 07:55:48.228729 27940 hybrid_clock.cc:648] HybridClock initialized: now 1790582148228697 us; error 70 us; skew 500 ppm
I20260928 07:55:48.229661 27940 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 07:55:48.237185 27940 webserver.cc:533] Webserver started at http://127.26.221.252:40429/ using document root <none> and password file <none>
I20260928 07:55:48.238335 27940 fs_manager.cc:362] Metadata directory not provided
I20260928 07:55:48.238579 27940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 07:55:48.239121 27940 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 07:55:48.243860 27940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/instance:
uuid: "b64b51f6f084474eb360161ac99f9b16"
format_stamp: "Formatted at 2026-09-28 07:55:48 on dist-test-slave-mf55"
I20260928 07:55:48.245065 27940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal/instance:
uuid: "b64b51f6f084474eb360161ac99f9b16"
format_stamp: "Formatted at 2026-09-28 07:55:48 on dist-test-slave-mf55"
I20260928 07:55:48.253800 27940 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.007s sys 0.001s
I20260928 07:55:48.262059 27966 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:48.263394 27940 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260928 07:55:48.263917 27940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data,/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
uuid: "b64b51f6f084474eb360161ac99f9b16"
format_stamp: "Formatted at 2026-09-28 07:55:48 on dist-test-slave-mf55"
I20260928 07:55:48.264374 27940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 07:55:48.341698 27940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 07:55:48.343266 27940 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 07:55:48.343748 27940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 07:55:48.427205 27940 rpc_server.cc:307] RPC server started. Bound to: 127.26.221.252:41205
I20260928 07:55:48.427304 28017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.221.252:41205 every 8 connection(s)
I20260928 07:55:48.430080 27940 server_base.cc:1193] Dumped server information to /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/info.pb
I20260928 07:55:48.436820 28018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:48.439716 27511 external_mini_cluster.cc:1434] Started /tmp/dist-test-task47VKlj/build/tsan/bin/kudu as pid 27940
I20260928 07:55:48.440227 27511 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal/instance
I20260928 07:55:48.454466 28018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } has no permanent_uuid. Determining permanent_uuid...
I20260928 07:55:48.485994 28018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } has no permanent_uuid. Determining permanent_uuid...
I20260928 07:55:48.500710 28018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } has no permanent_uuid. Determining permanent_uuid...
I20260928 07:55:48.521899 28018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Bootstrap starting.
I20260928 07:55:48.528764 28018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:48.530784 28018 log.cc:826] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Log is configured to *not* fsync() on all Append() calls
I20260928 07:55:48.536410 28018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: No bootstrap required, opened a new log
I20260928 07:55:48.554947 28018 raft_consensus.cc:359] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:48.555670 28018 raft_consensus.cc:385] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:48.556031 28018 raft_consensus.cc:740] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b64b51f6f084474eb360161ac99f9b16, State: Initialized, Role: FOLLOWER
I20260928 07:55:48.557135 28018 consensus_queue.cc:260] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:48.559864 28028 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:48.560537 28028 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:48.561383 28018 sys_catalog.cc:565] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: configured and running, proceeding with master startup.
W20260928 07:55:48.599315 27972 tablet.cc:2433] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 07:55:48.606925 28042 catalog_manager.cc:1607] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 07:55:48.607497 28042 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 07:55:48.589262 27940 master_runner.cc:187] Error getting master registration for 127.26.221.254:36357: OK, instance_id { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" instance_seqno: 1790582144437898 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 07:55:48.629791 27940 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 07:55:48.783399 27939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 7
I20260928 07:55:48.803625 27939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: Bootstrap starting.
I20260928 07:55:48.809545 27939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:48.811376 27939 log.cc:826] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: Log is configured to *not* fsync() on all Append() calls
I20260928 07:55:48.816305 27939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: No bootstrap required, opened a new log
I20260928 07:55:48.837671 27939 raft_consensus.cc:359] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:48.838392 27939 raft_consensus.cc:385] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:48.838651 27939 raft_consensus.cc:740] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f95afb2252e047ff9f5427a1cd7c0df0, State: Initialized, Role: FOLLOWER
I20260928 07:55:48.839449 27939 consensus_queue.cc:260] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:48.842485 28048 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:48.843319 28048 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:48.844329 27939 sys_catalog.cc:565] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: configured and running, proceeding with master startup.
W20260928 07:55:48.907959 28062 catalog_manager.cc:1607] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 07:55:48.908411 28062 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 07:55:48.876823 27865 master_runner.cc:187] Error getting master registration for 127.26.221.254:36357: OK, instance_id { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" instance_seqno: 1790582144437898 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 07:55:48.911952 27865 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 07:55:48.993762 28028 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:55:48.994444 28028 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:49.006174 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:55:49.007313 27914 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b64b51f6f084474eb360161ac99f9b16 in term 0.
I20260928 07:55:49.009443 28028 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:55:49.009562 27967 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, f95afb2252e047ff9f5427a1cd7c0df0; no voters:
I20260928 07:55:49.012228 28028 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:55:49.012975 28028 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:55:49.016623 28028 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:55:49.081730 27893 tablet.cc:2433] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 07:55:49.100205 28028 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:49.102442 28028 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 1 election: Requested vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:55:49.108254 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
I20260928 07:55:49.108870 27914 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:49.169864 27864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } attempt: 7
I20260928 07:55:49.193573 27864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Bootstrap starting.
I20260928 07:55:49.201315 27914 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b64b51f6f084474eb360161ac99f9b16 in term 1.
I20260928 07:55:49.208596 27967 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, f95afb2252e047ff9f5427a1cd7c0df0; no voters:
I20260928 07:55:49.210007 28028 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:55:49.210619 28028 raft_consensus.cc:697] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 1 LEADER]: Becoming Leader. State: Replica: b64b51f6f084474eb360161ac99f9b16, State: Running, Role: LEADER
I20260928 07:55:49.211776 27864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:49.211716 28028 consensus_queue.cc:237] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:49.214715 27864 log.cc:826] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Log is configured to *not* fsync() on all Append() calls
I20260928 07:55:49.226154 27864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: No bootstrap required, opened a new log
I20260928 07:55:49.226580 28065 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b64b51f6f084474eb360161ac99f9b16. Latest consensus state: current_term: 1 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:49.227421 28065 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:49.243000 28069 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 07:55:49.254738 28069 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 07:55:49.265880 27864 raft_consensus.cc:359] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:49.266978 27864 raft_consensus.cc:385] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:49.267401 27864 raft_consensus.cc:740] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfb6604d9ebb423090c878c2b1db0cab, State: Initialized, Role: FOLLOWER
I20260928 07:55:49.268543 27864 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:49.273425 27864 sys_catalog.cc:565] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: configured and running, proceeding with master startup.
I20260928 07:55:49.273576 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab"
I20260928 07:55:49.274363 27838 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:49.287580 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:49.272128 28070 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:49.297209 28070 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:49.307039 27914 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 1 FOLLOWER]: Refusing update from remote peer b64b51f6f084474eb360161ac99f9b16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:55:49.310266 28065 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:55:49.360827 28048 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b64b51f6f084474eb360161ac99f9b16. Latest consensus state: current_term: 1 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:49.361622 28048 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 07:55:49.393846 27818 tablet.cc:2433] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 07:55:49.419770 27838 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b64b51f6f084474eb360161ac99f9b16 in term 1.
I20260928 07:55:49.422034 27839 raft_consensus.cc:1275] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 1 FOLLOWER]: Refusing update from remote peer b64b51f6f084474eb360161ac99f9b16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:55:49.428802 28065 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:55:49.470453 28048 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:49.471352 28048 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:49.498330 28070 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: New leader b64b51f6f084474eb360161ac99f9b16. Latest consensus state: current_term: 1 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:49.499603 28070 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:49.504151 28028 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:49.505054 28028 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:49.505990 28028 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:49.506747 28028 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:49.524255 28069 catalog_manager.cc:1396] Generated new cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:55:49.524561 28069 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 07:55:49.524574 28070 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:49.525290 28070 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:49.564916 28094 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 07:55:49.621806 28069 catalog_manager.cc:1419] Generated new certificate authority record
I20260928 07:55:49.624260 28069 catalog_manager.cc:1553] Loading token signing keys...
I20260928 07:55:49.670159 28069 catalog_manager.cc:6219] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Generated new TSK 0
I20260928 07:55:49.671803 28069 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 07:55:49.676201 28069 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 07:55:49.680759 28069 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260928 07:55:49.735533 27511 external_mini_cluster.cc:1372] Running /tmp/dist-test-task47VKlj/build/tsan/bin/kudu
/tmp/dist-test-task47VKlj/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.221.193:0
--local_ip_for_outbound_sockets=127.26.221.193
--webserver_interface=127.26.221.193
--webserver_port=0
--tserver_master_addrs=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--builtin_ntp_servers=127.26.221.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 07:55:49.914914 28062 catalog_manager.cc:1308] Loaded cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:55:49.915325 28062 catalog_manager.cc:1601] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: loading cluster ID for follower catalog manager: success
I20260928 07:55:49.931677 28062 catalog_manager.cc:1623] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: acquiring CA information for follower catalog manager: success
I20260928 07:55:49.937943 28062 catalog_manager.cc:1651] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 07:55:50.182677 28098 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b64b51f6f084474eb360161ac99f9b16)
I20260928 07:55:50.183478 28098 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:50.187675 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:50.188508 27839 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f95afb2252e047ff9f5427a1cd7c0df0 in term 1.
I20260928 07:55:50.190033 28098 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:50.190160 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0; no voters:
I20260928 07:55:50.191009 28098 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 07:55:50.191620 28098 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b64b51f6f084474eb360161ac99f9b16)
I20260928 07:55:50.192245 28098 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 07:55:50.219264 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:50.226802 28097 raft_consensus.cc:493] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b64b51f6f084474eb360161ac99f9b16)
I20260928 07:55:50.227603 28097 raft_consensus.cc:515] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:50.232317 27913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:55:50.233608 28098 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:50.235679 28098 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 2 election: Requested vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:50.236384 27914 raft_consensus.cc:1240] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Rejecting Update request from peer b64b51f6f084474eb360161ac99f9b16 for earlier term 1. Current term is 2. Ops: []
I20260928 07:55:50.241709 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab"
I20260928 07:55:50.243202 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16"
I20260928 07:55:50.247308 28100 consensus_queue.cc:1059] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260928 07:55:50.248425 28100 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 07:55:50.248726 28100 raft_consensus.cc:740] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b64b51f6f084474eb360161ac99f9b16, State: Running, Role: LEADER
I20260928 07:55:50.250026 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:50.250893 28098 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 07:55:50.251688 28100 consensus_queue.cc:260] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:50.253350 28100 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 1 FOLLOWER]: Advancing to term 2
I20260928 07:55:50.263839 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:50.264974 28097 leader_election.cc:290] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:55:50.303278 28096 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 07:55:50.304059 28096 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 07:55:50.305100 28096 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260928 07:55:50.332043 27993 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfb6604d9ebb423090c878c2b1db0cab in term 2.
I20260928 07:55:50.337860 27816 leader_election.cc:304] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab; no voters: f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:55:50.341256 28097 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 07:55:50.341971 28097 raft_consensus.cc:493] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 1 FOLLOWER]: Starting leader election (detected failure of leader b64b51f6f084474eb360161ac99f9b16)
I20260928 07:55:50.342486 28097 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 1 FOLLOWER]: Advancing to term 2
W20260928 07:55:50.375982 28096 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 07:55:50.377617 28096 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.221.193
I20260928 07:55:50.445911 28097 raft_consensus.cc:515] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:50.448058 28096 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.221.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.221.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.221.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.221.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 07:43:23 UTC on e7f111948823
build id 14038
TSAN enabled
I20260928 07:55:50.448230 28097 leader_election.cc:290] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 2 election: Requested vote from peers f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:50.450078 28096 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 07:55:50.451570 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
I20260928 07:55:50.452451 27914 raft_consensus.cc:2393] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dfb6604d9ebb423090c878c2b1db0cab in current term 2: Already voted for candidate f95afb2252e047ff9f5427a1cd7c0df0 in this term.
I20260928 07:55:50.452677 28096 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260928 07:55:50.462787 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16"
W20260928 07:55:50.512804 28106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 07:55:50.526499 27993 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfb6604d9ebb423090c878c2b1db0cab in term 2.
I20260928 07:55:50.528606 27816 leader_election.cc:304] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab; no voters: f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:55:50.529840 28097 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 2 FOLLOWER]: Leader election won for term 2
I20260928 07:55:50.537928 28097 raft_consensus.cc:697] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 2 LEADER]: Becoming Leader. State: Replica: dfb6604d9ebb423090c878c2b1db0cab, State: Running, Role: LEADER
I20260928 07:55:50.540113 28097 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:50.551882 28111 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 2 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:50.552678 28111 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:50.591179 28094 catalog_manager.cc:1308] Loaded cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:55:50.597350 28094 catalog_manager.cc:1601] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: loading cluster ID for follower catalog manager: success
I20260928 07:55:50.614663 28042 catalog_manager.cc:1651] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 07:55:50.618062 28094 catalog_manager.cc:1623] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: acquiring CA information for follower catalog manager: success
I20260928 07:55:50.630963 28094 catalog_manager.cc:1651] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 07:55:50.649585 28112 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 07:55:50.658631 28112 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 07:55:50.663436 28112 catalog_manager.cc:1308] Loaded cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:55:50.670246 28112 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 07:55:50.688442 28112 catalog_manager.cc:1553] Loading token signing keys...
I20260928 07:55:50.693202 28112 catalog_manager.cc:6230] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Loaded TSK: 0
I20260928 07:55:50.702600 28112 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 07:55:50.715541 28112 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 07:55:50.724656 28112 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260928 07:55:50.960013 28115 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:55:50.960812 28115 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:50.968110 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:50.978615 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:50.979372 27993 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f95afb2252e047ff9f5427a1cd7c0df0 in term 2.
I20260928 07:55:50.980952 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, f95afb2252e047ff9f5427a1cd7c0df0; no voters: dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:50.988168 27993 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 2 FOLLOWER]: Refusing update from remote peer dfb6604d9ebb423090c878c2b1db0cab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260928 07:55:50.990134 28116 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 07:55:50.990614 28116 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:55:50.990401 28111 consensus_queue.cc:1048] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 07:55:50.991094 28116 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 07:55:50.993263 28115 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:51.048758 28117 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 2 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:51.049639 28117 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:51.051505 28121 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:51.052237 28121 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:51.057469 28097 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:51.058197 28097 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:51.070065 28116 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:51.072360 28116 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 3 election: Requested vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:51.074841 27914 raft_consensus.cc:1240] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 3 FOLLOWER]: Rejecting Update request from peer dfb6604d9ebb423090c878c2b1db0cab for earlier term 2. Current term is 3. Ops: []
I20260928 07:55:51.079856 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab"
I20260928 07:55:51.081135 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16"
I20260928 07:55:51.082263 28111 consensus_queue.cc:1059] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 07:55:51.083129 28111 raft_consensus.cc:3055] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 2 LEADER]: Stepping down as leader of term 2
I20260928 07:55:51.083436 28111 raft_consensus.cc:740] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dfb6604d9ebb423090c878c2b1db0cab, State: Running, Role: LEADER
I20260928 07:55:51.084252 28111 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:51.088274 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:51.089107 28116 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260928 07:55:51.089665 28111 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 2 FOLLOWER]: Advancing to term 3
I20260928 07:55:51.478111 28111 raft_consensus.cc:493] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:55:51.478627 28111 raft_consensus.cc:515] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:51.481375 28111 leader_election.cc:290] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:51.482753 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:51.482929 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:55:51.483568 27914 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfb6604d9ebb423090c878c2b1db0cab in term 3.
I20260928 07:55:51.485297 27813 leader_election.cc:304] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16
I20260928 07:55:51.486516 28111 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 07:55:51.486898 28111 raft_consensus.cc:493] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:55:51.487289 28111 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 3 FOLLOWER]: Advancing to term 4
I20260928 07:55:51.496438 28111 raft_consensus.cc:515] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:51.504539 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
I20260928 07:55:51.505177 27914 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 3 FOLLOWER]: Advancing to term 4
I20260928 07:55:51.512470 27914 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfb6604d9ebb423090c878c2b1db0cab in term 4.
I20260928 07:55:51.513960 27813 leader_election.cc:304] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0; no voters:
I20260928 07:55:51.514971 28097 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 4 FOLLOWER]: Leader election won for term 4
I20260928 07:55:51.522987 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16"
I20260928 07:55:51.524904 28097 raft_consensus.cc:697] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 4 LEADER]: Becoming Leader. State: Replica: dfb6604d9ebb423090c878c2b1db0cab, State: Running, Role: LEADER
I20260928 07:55:51.525751 28121 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:51.526230 28121 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:51.526063 28097 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:51.528214 28121 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:55:51.530723 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:51.532160 28122 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:51.532965 28122 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:51.532856 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:55:51.533620 27914 raft_consensus.cc:2368] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b64b51f6f084474eb360161ac99f9b16 for earlier term 3. Current term is 4.
I20260928 07:55:51.533656 28112 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 07:55:51.534929 27967 leader_election.cc:400] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 3 pre-election: Vote denied by peer f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b64b51f6f084474eb360161ac99f9b16 for earlier term 3. Current term is 4.
I20260928 07:55:51.535233 27967 leader_election.cc:403] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260928 07:55:51.536170 28121 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 2 FOLLOWER]: Advancing to term 4
I20260928 07:55:51.543392 28112 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 07:55:51.544203 28121 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b64b51f6f084474eb360161ac99f9b16 for earlier term 3. Current term is 4.
I20260928 07:55:51.530956 28111 leader_election.cc:290] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 4 election: Requested vote from peers f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:51.551720 28112 catalog_manager.cc:1308] Loaded cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:55:51.556537 28112 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 07:55:51.565042 28112 catalog_manager.cc:1553] Loading token signing keys...
I20260928 07:55:51.577088 28112 catalog_manager.cc:6230] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Loaded TSK: 0
I20260928 07:55:51.578226 28112 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 07:55:51.591325 28112 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 07:55:51.596472 28112 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260928 07:55:52.053090 27993 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Refusing update from remote peer dfb6604d9ebb423090c878c2b1db0cab: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260928 07:55:52.058647 27914 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Refusing update from remote peer dfb6604d9ebb423090c878c2b1db0cab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260928 07:55:52.064869 28123 consensus_queue.cc:1048] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260928 07:55:52.067938 28125 consensus_queue.cc:1048] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 07:55:52.094746 28127 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:52.096210 28127 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:52.105722 28123 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:52.107538 28123 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:52.119656 28127 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:52.120744 28127 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:52.126958 28126 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:52.127775 28126 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:52.126821 28134 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:52.128338 28134 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:55:52.131150 28124 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:52.132341 28124 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:52.134774 28134 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:52.136513 28134 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 07:55:50.529860 28110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:50.520138 28107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:52.365906 28108 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1851 milliseconds
I20260928 07:55:52.366099 28096 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 07:55:52.371397 28096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 07:55:52.374400 28096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 07:55:52.375888 28096 hybrid_clock.cc:648] HybridClock initialized: now 1790582152375821 us; error 82 us; skew 500 ppm
I20260928 07:55:52.376850 28096 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 07:55:52.384608 28096 webserver.cc:533] Webserver started at http://127.26.221.193:35461/ using document root <none> and password file <none>
I20260928 07:55:52.385667 28096 fs_manager.cc:362] Metadata directory not provided
I20260928 07:55:52.385903 28096 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 07:55:52.386410 28096 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 07:55:52.390901 28096 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/data/instance:
uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
format_stamp: "Formatted at 2026-09-28 07:55:52 on dist-test-slave-mf55"
I20260928 07:55:52.392079 28096 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/instance:
uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
format_stamp: "Formatted at 2026-09-28 07:55:52 on dist-test-slave-mf55"
I20260928 07:55:52.401307 28096 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.011s sys 0.001s
I20260928 07:55:52.409492 28139 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:52.411012 28096 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260928 07:55:52.411413 28096 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/data,/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal
uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
format_stamp: "Formatted at 2026-09-28 07:55:52 on dist-test-slave-mf55"
I20260928 07:55:52.411800 28096 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 07:55:52.526641 28096 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 07:55:52.528244 28096 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 07:55:52.528720 28096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 07:55:52.532095 28096 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 07:55:52.537353 28096 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 07:55:52.537559 28096 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:52.537880 28096 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 07:55:52.538054 28096 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:52.633682 28134 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:52.634207 28134 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:52.636262 28134 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:52.637426 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:52.637537 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:52.639206 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:52.640614 28134 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 07:55:52.748211 28096 rpc_server.cc:307] RPC server started. Bound to: 127.26.221.193:33039
I20260928 07:55:52.748332 28252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.221.193:33039 every 8 connection(s)
I20260928 07:55:52.751137 28096 server_base.cc:1193] Dumped server information to /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/data/info.pb
I20260928 07:55:52.753504 27511 external_mini_cluster.cc:1434] Started /tmp/dist-test-task47VKlj/build/tsan/bin/kudu as pid 28096
I20260928 07:55:52.753978 27511 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/instance
I20260928 07:55:52.779539 27511 external_mini_cluster.cc:1372] Running /tmp/dist-test-task47VKlj/build/tsan/bin/kudu
/tmp/dist-test-task47VKlj/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.221.194:0
--local_ip_for_outbound_sockets=127.26.221.194
--webserver_interface=127.26.221.194
--webserver_port=0
--tserver_master_addrs=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--builtin_ntp_servers=127.26.221.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 07:55:52.803000 28255 heartbeater.cc:344] Connected to a master server at 127.26.221.254:36357
I20260928 07:55:52.803558 28255 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:52.805040 28255 heartbeater.cc:507] Master 127.26.221.254:36357 requested a full tablet report, sending...
I20260928 07:55:52.807497 28254 heartbeater.cc:344] Connected to a master server at 127.26.221.253:45305
I20260928 07:55:52.807672 28253 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:55:52.807842 28254 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:52.808020 28253 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:52.808637 27829 ts_manager.cc:194] Registered new tserver with Master: acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:55:52.808940 28254 heartbeater.cc:507] Master 127.26.221.253:45305 requested a full tablet report, sending...
I20260928 07:55:52.809242 28253 heartbeater.cc:507] Master 127.26.221.252:41205 requested a full tablet report, sending...
I20260928 07:55:52.812150 27904 ts_manager.cc:194] Registered new tserver with Master: acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:55:52.812109 27829 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.221.193:56531
I20260928 07:55:52.812335 27983 ts_manager.cc:194] Registered new tserver with Master: acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:55:53.040788 28264 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:53.041334 28264 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:53.044381 28264 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:55:53.044693 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:53.045189 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:55:53.047063 27969 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16; no voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:55:53.047876 28264 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 07:55:53.136304 28263 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 07:55:53.136869 28263 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 07:55:53.137562 28263 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 07:55:53.175076 28263 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 07:55:53.176138 28263 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.221.194
I20260928 07:55:53.216476 28263 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.221.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.221.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.221.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.221.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 07:43:23 UTC on e7f111948823
build id 14038
TSAN enabled
I20260928 07:55:53.217993 28263 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 07:55:53.219738 28263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 07:55:53.234318 28270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 07:55:53.317880 28255 heartbeater.cc:499] Master 127.26.221.254:36357 was elected leader, sending a full tablet report...
I20260928 07:55:53.648723 28276 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:53.649537 28276 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:53.652163 28276 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:53.654402 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:53.654645 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:53.658159 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:53.659823 28276 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 07:55:53.989521 28277 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:53.990298 28277 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:53.993018 28277 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:55:53.994427 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:53.995250 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:55:53.997543 27967 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16; no voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:55:53.998835 28277 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 07:55:54.194073 28278 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:54.194763 28278 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:54.197510 28278 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:54.198813 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:54.199951 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:54.203063 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:54.204350 28278 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 07:55:53.238531 28271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:53.240837 28273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:54.578205 28272 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1339 milliseconds
I20260928 07:55:54.578553 28263 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 07:55:54.579883 28263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 07:55:54.582261 28263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 07:55:54.583691 28263 hybrid_clock.cc:648] HybridClock initialized: now 1790582154583624 us; error 78 us; skew 500 ppm
I20260928 07:55:54.584901 28263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 07:55:54.591089 28263 webserver.cc:533] Webserver started at http://127.26.221.194:34841/ using document root <none> and password file <none>
I20260928 07:55:54.592000 28263 fs_manager.cc:362] Metadata directory not provided
I20260928 07:55:54.592199 28263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 07:55:54.592617 28263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 07:55:54.597077 28263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/data/instance:
uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
format_stamp: "Formatted at 2026-09-28 07:55:54 on dist-test-slave-mf55"
I20260928 07:55:54.598269 28263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/instance:
uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
format_stamp: "Formatted at 2026-09-28 07:55:54 on dist-test-slave-mf55"
I20260928 07:55:54.606171 28263 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260928 07:55:54.612344 28283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:54.613739 28263 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260928 07:55:54.614187 28263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/data,/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal
uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
format_stamp: "Formatted at 2026-09-28 07:55:54 on dist-test-slave-mf55"
I20260928 07:55:54.614552 28263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 07:55:54.669868 28263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 07:55:54.671833 28263 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 07:55:54.672338 28263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 07:55:54.675172 28263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 07:55:54.679945 28263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 07:55:54.680181 28263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:54.680394 28263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 07:55:54.680536 28263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:54.836988 28263 rpc_server.cc:307] RPC server started. Bound to: 127.26.221.194:42035
I20260928 07:55:54.837117 28396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.221.194:42035 every 8 connection(s)
I20260928 07:55:54.840070 28263 server_base.cc:1193] Dumped server information to /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/data/info.pb
I20260928 07:55:54.844007 27511 external_mini_cluster.cc:1434] Started /tmp/dist-test-task47VKlj/build/tsan/bin/kudu as pid 28263
I20260928 07:55:54.844861 27511 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/instance
I20260928 07:55:54.882474 27511 external_mini_cluster.cc:1372] Running /tmp/dist-test-task47VKlj/build/tsan/bin/kudu
/tmp/dist-test-task47VKlj/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.221.195:0
--local_ip_for_outbound_sockets=127.26.221.195
--webserver_interface=127.26.221.195
--webserver_port=0
--tserver_master_addrs=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--builtin_ntp_servers=127.26.221.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 07:55:54.893508 28398 heartbeater.cc:344] Connected to a master server at 127.26.221.253:45305
I20260928 07:55:54.894078 28398 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:54.892997 28399 heartbeater.cc:344] Connected to a master server at 127.26.221.254:36357
I20260928 07:55:54.894623 28399 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:54.895267 28398 heartbeater.cc:507] Master 127.26.221.253:45305 requested a full tablet report, sending...
I20260928 07:55:54.895862 28399 heartbeater.cc:507] Master 127.26.221.254:36357 requested a full tablet report, sending...
I20260928 07:55:54.898466 27904 ts_manager.cc:194] Registered new tserver with Master: 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:55:54.898430 27829 ts_manager.cc:194] Registered new tserver with Master: 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:55:54.900810 27829 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.221.194:49827
I20260928 07:55:54.906652 28397 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:55:54.907014 28397 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:54.907579 28397 heartbeater.cc:507] Master 127.26.221.252:41205 requested a full tablet report, sending...
I20260928 07:55:54.910228 27983 ts_manager.cc:194] Registered new tserver with Master: 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:55:54.994937 28408 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:54.995410 28408 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:54.997014 28408 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:55:54.998159 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:54.998836 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:55:55.001770 27967 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16; no voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:55:55.002830 28408 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 07:55:55.223680 28407 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 07:55:55.224208 28407 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 07:55:55.224706 28407 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 07:55:55.260813 28407 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 07:55:55.261807 28407 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.221.195
I20260928 07:55:55.300228 28407 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.221.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.221.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.221.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.221.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 07:43:23 UTC on e7f111948823
build id 14038
TSAN enabled
I20260928 07:55:55.301820 28407 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 07:55:55.303599 28407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 07:55:55.317009 28414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 07:55:55.407886 28399 heartbeater.cc:499] Master 127.26.221.254:36357 was elected leader, sending a full tablet report...
I20260928 07:55:55.582288 28420 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:55.583209 28420 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:55.588539 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:55.592087 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:55.594511 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:55.599576 28420 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:55.600914 28420 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 07:55:56.200151 28423 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:56.201747 28423 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:56.206789 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:56.212313 27993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:55:56.215138 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:56.219731 28423 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:56.221153 28423 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 07:55:56.482182 28425 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:56.483002 28425 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:56.487205 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:56.490237 28425 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:55:56.492352 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:55:56.495275 27967 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16; no voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:55:56.497296 28425 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 07:55:56.720144 28413 debug-util.cc:398] Leaking SignalData structure 0x7b0800037180 after lost signal to thread 28407
W20260928 07:55:56.878240 28407 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.561s user 0.630s sys 0.895s
W20260928 07:55:55.318063 28415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:56.878714 28407 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.562s user 0.630s sys 0.896s
W20260928 07:55:56.880697 28417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 07:55:56.883368 28416 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1565 milliseconds
I20260928 07:55:56.883414 28407 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 07:55:56.884711 28407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 07:55:56.887032 28407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 07:55:56.888585 28407 hybrid_clock.cc:648] HybridClock initialized: now 1790582156888571 us; error 86 us; skew 500 ppm
I20260928 07:55:56.889711 28407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 07:55:56.896915 28407 webserver.cc:533] Webserver started at http://127.26.221.195:42131/ using document root <none> and password file <none>
I20260928 07:55:56.898129 28407 fs_manager.cc:362] Metadata directory not provided
I20260928 07:55:56.898424 28407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 07:55:56.898944 28407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 07:55:56.904403 28407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/data/instance:
uuid: "bae11841a62f429a98a978de5b7bd60e"
format_stamp: "Formatted at 2026-09-28 07:55:56 on dist-test-slave-mf55"
I20260928 07:55:56.905941 28407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/instance:
uuid: "bae11841a62f429a98a978de5b7bd60e"
format_stamp: "Formatted at 2026-09-28 07:55:56 on dist-test-slave-mf55"
I20260928 07:55:56.914669 28407 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.002s
I20260928 07:55:56.922106 28431 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:56.923843 28407 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260928 07:55:56.924278 28407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/data,/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal
uuid: "bae11841a62f429a98a978de5b7bd60e"
format_stamp: "Formatted at 2026-09-28 07:55:56 on dist-test-slave-mf55"
I20260928 07:55:56.924681 28407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 07:55:57.008522 28407 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 07:55:57.010412 28407 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 07:55:57.011022 28407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 07:55:57.014187 28407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 07:55:57.018728 28407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 07:55:57.018986 28407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:57.019338 28407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 07:55:57.019488 28407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 07:55:57.163987 28407 rpc_server.cc:307] RPC server started. Bound to: 127.26.221.195:44497
I20260928 07:55:57.164090 28543 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.221.195:44497 every 8 connection(s)
I20260928 07:55:57.167093 28407 server_base.cc:1193] Dumped server information to /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/data/info.pb
I20260928 07:55:57.177908 27511 external_mini_cluster.cc:1434] Started /tmp/dist-test-task47VKlj/build/tsan/bin/kudu as pid 28407
I20260928 07:55:57.178802 27511 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/instance
I20260928 07:55:57.217460 28544 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:55:57.217932 28544 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:57.218614 28546 heartbeater.cc:344] Connected to a master server at 127.26.221.254:36357
I20260928 07:55:57.218991 28546 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:57.219586 28544 heartbeater.cc:507] Master 127.26.221.252:41205 requested a full tablet report, sending...
I20260928 07:55:57.220402 28546 heartbeater.cc:507] Master 127.26.221.254:36357 requested a full tablet report, sending...
I20260928 07:55:57.221159 28545 heartbeater.cc:344] Connected to a master server at 127.26.221.253:45305
I20260928 07:55:57.221789 28545 heartbeater.cc:461] Registering TS with master...
I20260928 07:55:57.222666 28545 heartbeater.cc:507] Master 127.26.221.253:45305 requested a full tablet report, sending...
I20260928 07:55:57.223133 27829 ts_manager.cc:194] Registered new tserver with Master: bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:57.223646 27982 ts_manager.cc:194] Registered new tserver with Master: bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:57.225128 27829 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.221.195:41067
I20260928 07:55:57.226643 27904 ts_manager.cc:194] Registered new tserver with Master: bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:57.231172 27511 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260928 07:55:57.319353 27511 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task47VKlj/build/tsan/bin/kudu with pid 27940
I20260928 07:55:57.293094 27826 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_2cecddd82a2240278979dcdd6f8419d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:55:57.291908 27827 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_ccb180d575274679b4d4cfbdc4622d34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:55:57.291093 27829 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_d9b32ff27e7c49f1b841391b3e35ea50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:55:57.292748 27828 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_8b06fb4bc5314df789c0bf92a96b2811"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 07:55:57.334993 27826 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2cecddd82a2240278979dcdd6f8419d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:55:57.339874 27829 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d9b32ff27e7c49f1b841391b3e35ea50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:55:57.340049 27827 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ccb180d575274679b4d4cfbdc4622d34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:55:57.341967 27828 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8b06fb4bc5314df789c0bf92a96b2811 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:55:57.384917 28253 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:55:57.447820 27816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 13 similar messages]
W20260928 07:55:57.451462 28397 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:55:57.471662 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 07:55:57.728721 28546 heartbeater.cc:499] Master 127.26.221.254:36357 was elected leader, sending a full tablet report...
W20260928 07:55:57.756918 28544 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:57.997618 28124 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:55:57.998699 28124 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:55:58.138255 27826 catalog_manager.cc:2213] created HMS catalog entry for table [id=1fe89d7dbd8f4ac092797bdc68966aed]
I20260928 07:55:58.288535 27826 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_2cecddd82a2240278979dcdd6f8419d7" } new_table_name: "default.Table_5554a4e3daa34b5bae576237453e3c77" modify_external_catalogs: true
I20260928 07:55:58.312637 27829 catalog_manager.cc:2213] created HMS catalog entry for table [id=527c9391fe3c46d8baaa5d45edb03c39]
I20260928 07:55:58.344328 27829 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 1) took 1054 ms. Trace:
I20260928 07:55:58.344878 27829 rpcz_store.cc:276] 0928 07:55:57.290349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:57.290491 (+ 142us) service_pool.cc:224] Handling call
0928 07:55:57.340426 (+ 49935us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:55:57.344426 (+ 4000us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:55:58.312587 (+968161us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:55:58.343546 (+ 30959us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:55:58.343909 (+ 363us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:55:58.344245 (+ 336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:55:58.314530 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:55:58.315013 (+ 483us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:55:58.315040 (+ 27us) write_op.cc:435] Acquired schema lock
0928 07:55:58.315053 (+ 13us) tablet.cc:662] Decoding operations
0928 07:55:58.315372 (+ 319us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:55:58.315417 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0928 07:55:58.315442 (+ 25us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:55:58.315687 (+ 245us) tablet.cc:701] Row locks acquired
0928 07:55:58.315705 (+ 18us) write_op.cc:260] PREPARE: finished
0928 07:55:58.315833 (+ 128us) write_op.cc:270] Start()
0928 07:55:58.315933 (+ 100us) write_op.cc:276] Timestamp: P: 1790582158315802 usec, L: 0
0928 07:55:58.315949 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 07:55:58.316495 (+ 546us) log.cc:844] Serialized 432 byte log entry
0928 07:55:58.340706 (+ 24211us) op_driver.cc:464] REPLICATION: finished
0928 07:55:58.341116 (+ 410us) write_op.cc:301] APPLY: starting
0928 07:55:58.341171 (+ 55us) tablet.cc:1394] starting BulkCheckPresence
0928 07:55:58.341309 (+ 138us) tablet.cc:1397] finished BulkCheckPresence
0928 07:55:58.341415 (+ 106us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:55:58.341821 (+ 406us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:55:58.341959 (+ 138us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:55:58.342002 (+ 43us) write_op.cc:312] APPLY: finished
0928 07:55:58.342199 (+ 197us) log.cc:844] Serialized 28 byte log entry
0928 07:55:58.342356 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:55:58.342427 (+ 71us) write_op.cc:454] Released schema lock
0928 07:55:58.342461 (+ 34us) write_op.cc:341] FINISH: Updating metrics
0928 07:55:58.342696 (+ 235us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:55:58.342719 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":793191,"Hive Metastore.run_cpu_time_us":656,"Hive Metastore.run_wall_time_us":174375,"spinlock_wait_cycles":184064,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":1549,"apply.run_wall_time_us":1548,"mutex_wait_us":886,"num_ops":2,"prepare.queue_time_us":184,"prepare.run_cpu_time_us":2345,"prepare.run_wall_time_us":2345,"raft.queue_time_us":448,"raft.run_cpu_time_us":793,"raft.run_wall_time_us":794,"replication_time_us":24653}]]}
I20260928 07:55:58.432289 27829 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_d9b32ff27e7c49f1b841391b3e35ea50" } new_table_name: "default.Table_6ba15b125765407a97c61d226b03034e" modify_external_catalogs: true
I20260928 07:55:58.460765 27827 catalog_manager.cc:2213] created HMS catalog entry for table [id=9241655678a6423ea1a261d4630fd361]
I20260928 07:55:58.475899 27825 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_b683bb3b8dc3479ea1bb3735c0fb55af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:55:58.485679 27827 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 3) took 1194 ms. Trace:
I20260928 07:55:58.486253 27827 rpcz_store.cc:276] 0928 07:55:57.291114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:57.291463 (+ 349us) service_pool.cc:224] Handling call
0928 07:55:57.343251 (+ 51788us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:55:57.345424 (+ 2173us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:55:58.460700 (+1115276us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:55:58.484834 (+ 24134us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:55:58.485179 (+ 345us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:55:58.485585 (+ 406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:55:58.463115 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:55:58.463585 (+ 470us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:55:58.463614 (+ 29us) write_op.cc:435] Acquired schema lock
0928 07:55:58.463629 (+ 15us) tablet.cc:662] Decoding operations
0928 07:55:58.463943 (+ 314us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:55:58.463999 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0928 07:55:58.464029 (+ 30us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:55:58.464351 (+ 322us) tablet.cc:701] Row locks acquired
0928 07:55:58.464372 (+ 21us) write_op.cc:260] PREPARE: finished
0928 07:55:58.464511 (+ 139us) write_op.cc:270] Start()
0928 07:55:58.464607 (+ 96us) write_op.cc:276] Timestamp: P: 1790582158464458 usec, L: 0
0928 07:55:58.464620 (+ 13us) op_driver.cc:348] REPLICATION: starting
0928 07:55:58.465165 (+ 545us) log.cc:844] Serialized 432 byte log entry
0928 07:55:58.474664 (+ 9499us) op_driver.cc:464] REPLICATION: finished
0928 07:55:58.475214 (+ 550us) write_op.cc:301] APPLY: starting
0928 07:55:58.475273 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 07:55:58.475376 (+ 103us) tablet.cc:1397] finished BulkCheckPresence
0928 07:55:58.475463 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:55:58.476077 (+ 614us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:55:58.476228 (+ 151us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:55:58.476271 (+ 43us) write_op.cc:312] APPLY: finished
0928 07:55:58.476455 (+ 184us) log.cc:844] Serialized 28 byte log entry
0928 07:55:58.476604 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:55:58.476674 (+ 70us) write_op.cc:454] Released schema lock
0928 07:55:58.476705 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 07:55:58.476948 (+ 243us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:55:58.476976 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":966617,"Hive Metastore.run_cpu_time_us":627,"Hive Metastore.run_wall_time_us":147209,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":375,"apply.run_cpu_time_us":1703,"apply.run_wall_time_us":1703,"mutex_wait_us":140,"num_ops":2,"prepare.queue_time_us":182,"prepare.run_cpu_time_us":2513,"prepare.run_wall_time_us":2644,"raft.queue_time_us":436,"raft.run_cpu_time_us":728,"raft.run_wall_time_us":727,"replication_time_us":9933}]]}
I20260928 07:55:58.504024 27827 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_ccb180d575274679b4d4cfbdc4622d34" } modify_external_catalogs: true
I20260928 07:55:58.504933 27827 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_ccb180d575274679b4d4cfbdc4622d34" } modify_external_catalogs: true
I20260928 07:55:58.529753 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 2f56b9e5701f41969d3edfa87fb95b13 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.530967 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 42bd773b7b66459aab84879bae66b79e (DEFAULT_TABLE table=default.table_2cecddd82a2240278979dcdd6f8419d7 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.531731 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f56b9e5701f41969d3edfa87fb95b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.533025 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bd773b7b66459aab84879bae66b79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.533758 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 2f56b9e5701f41969d3edfa87fb95b13 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.529525 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 42bd773b7b66459aab84879bae66b79e (DEFAULT_TABLE table=default.table_2cecddd82a2240278979dcdd6f8419d7 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.537390 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f56b9e5701f41969d3edfa87fb95b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.538368 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bd773b7b66459aab84879bae66b79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.540073 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 2f56b9e5701f41969d3edfa87fb95b13 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.546187 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f56b9e5701f41969d3edfa87fb95b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.552613 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 62ff57d55bcc4a33a5eb11ee87e3d461 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.554064 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ff57d55bcc4a33a5eb11ee87e3d461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.554241 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 62ff57d55bcc4a33a5eb11ee87e3d461 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.556088 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ff57d55bcc4a33a5eb11ee87e3d461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.561906 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 62ff57d55bcc4a33a5eb11ee87e3d461 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.563169 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ff57d55bcc4a33a5eb11ee87e3d461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.564857 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 42bd773b7b66459aab84879bae66b79e (DEFAULT_TABLE table=default.table_2cecddd82a2240278979dcdd6f8419d7 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.566059 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bd773b7b66459aab84879bae66b79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.610647 27824 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_c9320b8b140446b882ec239e50aabb4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:55:58.670904 28607 tablet_bootstrap.cc:492] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:55:58.681142 28608 tablet_bootstrap.cc:492] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:55:58.695902 28607 tablet_bootstrap.cc:654] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:58.703035 27823 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_cf5b0809ce954e06aacdc06963219c0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:55:58.706138 28607 log.cc:826] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Log is configured to *not* fsync() on all Append() calls
I20260928 07:55:58.707559 28609 tablet_bootstrap.cc:492] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:55:58.710708 28608 tablet_bootstrap.cc:654] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:58.717686 28607 tablet_bootstrap.cc:492] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:55:58.718353 28607 ts_tablet_manager.cc:1403] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.048s user 0.019s sys 0.004s
I20260928 07:55:58.713100 28608 log.cc:826] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: Log is configured to *not* fsync() on all Append() calls
I20260928 07:55:58.732542 27828 catalog_manager.cc:2213] created HMS catalog entry for table [id=16bd6197a0014263bed84d67e86249a4]
I20260928 07:55:58.734217 28608 tablet_bootstrap.cc:492] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:55:58.734760 28608 ts_tablet_manager.cc:1403] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.054s user 0.015s sys 0.005s
I20260928 07:55:58.724035 28609 tablet_bootstrap.cc:654] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:58.741683 28609 log.cc:826] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: Log is configured to *not* fsync() on all Append() calls
I20260928 07:55:58.751181 27828 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 2) took 1460 ms. Trace:
I20260928 07:55:58.751530 27828 rpcz_store.cc:276] 0928 07:55:57.290728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:57.292183 (+ 1455us) service_pool.cc:224] Handling call
0928 07:55:57.342470 (+ 50287us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:55:57.346479 (+ 4009us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:55:58.732493 (+1386014us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:55:58.750450 (+ 17957us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:55:58.750808 (+ 358us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:55:58.751112 (+ 304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:55:58.734659 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:55:58.735138 (+ 479us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:55:58.735166 (+ 28us) write_op.cc:435] Acquired schema lock
0928 07:55:58.735181 (+ 15us) tablet.cc:662] Decoding operations
0928 07:55:58.735556 (+ 375us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:55:58.735608 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0928 07:55:58.735638 (+ 30us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:55:58.735960 (+ 322us) tablet.cc:701] Row locks acquired
0928 07:55:58.735988 (+ 28us) write_op.cc:260] PREPARE: finished
0928 07:55:58.736126 (+ 138us) write_op.cc:270] Start()
0928 07:55:58.736222 (+ 96us) write_op.cc:276] Timestamp: P: 1790582158736039 usec, L: 0
0928 07:55:58.736246 (+ 24us) op_driver.cc:348] REPLICATION: starting
0928 07:55:58.736801 (+ 555us) log.cc:844] Serialized 432 byte log entry
0928 07:55:58.747712 (+ 10911us) op_driver.cc:464] REPLICATION: finished
0928 07:55:58.748144 (+ 432us) write_op.cc:301] APPLY: starting
0928 07:55:58.748203 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 07:55:58.748310 (+ 107us) tablet.cc:1397] finished BulkCheckPresence
0928 07:55:58.748396 (+ 86us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:55:58.748746 (+ 350us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:55:58.748873 (+ 127us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:55:58.748914 (+ 41us) write_op.cc:312] APPLY: finished
0928 07:55:58.749117 (+ 203us) log.cc:844] Serialized 28 byte log entry
0928 07:55:58.749292 (+ 175us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:55:58.749368 (+ 76us) write_op.cc:454] Released schema lock
0928 07:55:58.749401 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0928 07:55:58.749651 (+ 250us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:55:58.749679 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1113130,"Hive Metastore.run_cpu_time_us":770,"Hive Metastore.run_wall_time_us":272185,"child_traces":[["op",{"apply.queue_time_us":277,"apply.run_cpu_time_us":1459,"apply.run_wall_time_us":1458,"mutex_wait_us":1060,"num_ops":2,"prepare.queue_time_us":209,"prepare.run_cpu_time_us":2613,"prepare.run_wall_time_us":3657,"raft.queue_time_us":1308,"raft.run_cpu_time_us":755,"raft.run_wall_time_us":756,"replication_time_us":11336,"spinlock_wait_cycles":18816}]]}
I20260928 07:55:58.780829 27828 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_8b06fb4bc5314df789c0bf92a96b2811" } modify_external_catalogs: true
I20260928 07:55:58.785056 27828 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_8b06fb4bc5314df789c0bf92a96b2811" } modify_external_catalogs: true
I20260928 07:55:58.785331 28608 raft_consensus.cc:359] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:58.790184 28608 raft_consensus.cc:385] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:58.801376 28608 raft_consensus.cc:740] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:55:58.802985 28608 consensus_queue.cc:260] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:58.812255 28608 ts_tablet_manager.cc:1434] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.077s user 0.032s sys 0.005s
I20260928 07:55:58.815567 28608 tablet_bootstrap.cc:492] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:55:58.822365 28608 tablet_bootstrap.cc:654] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:58.835238 28186 tablet_service.cc:1511] Processing CreateTablet for tablet bc7e4a03df754b9a95bc5b9107dda783 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.836522 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7e4a03df754b9a95bc5b9107dda783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.837105 28329 tablet_service.cc:1511] Processing CreateTablet for tablet bc7e4a03df754b9a95bc5b9107dda783 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.838599 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7e4a03df754b9a95bc5b9107dda783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.851884 28478 tablet_service.cc:1511] Processing CreateTablet for tablet bc7e4a03df754b9a95bc5b9107dda783 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:58.852980 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7e4a03df754b9a95bc5b9107dda783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:58.860014 28608 tablet_bootstrap.cc:492] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:55:58.869657 28608 ts_tablet_manager.cc:1403] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.054s user 0.010s sys 0.003s
I20260928 07:55:58.878615 28607 raft_consensus.cc:359] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:58.880887 28607 raft_consensus.cc:385] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:58.881336 28607 raft_consensus.cc:740] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:55:58.882443 28607 consensus_queue.cc:260] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:58.882807 28608 raft_consensus.cc:359] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:58.883512 28608 raft_consensus.cc:385] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:58.883805 28608 raft_consensus.cc:740] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:55:58.884742 28608 consensus_queue.cc:260] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:58.889863 28609 tablet_bootstrap.cc:492] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:55:58.890441 28609 ts_tablet_manager.cc:1403] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.183s user 0.013s sys 0.022s
I20260928 07:55:58.890492 28608 ts_tablet_manager.cc:1434] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260928 07:55:58.891404 28608 tablet_bootstrap.cc:492] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:55:58.912112 28608 tablet_bootstrap.cc:654] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:58.923287 28607 ts_tablet_manager.cc:1434] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.205s user 0.032s sys 0.008s
W20260928 07:55:58.940508 28549 tablet.cc:2433] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 07:55:58.941277 28607 tablet_bootstrap.cc:492] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:55:58.947914 28607 tablet_bootstrap.cc:654] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:58.951363 28608 tablet_bootstrap.cc:492] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:55:58.951833 28608 ts_tablet_manager.cc:1403] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.003s
I20260928 07:55:58.954491 28608 raft_consensus.cc:359] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:58.955190 28608 raft_consensus.cc:385] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:58.955464 28608 raft_consensus.cc:740] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:55:58.957056 28609 raft_consensus.cc:359] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:58.959966 28609 raft_consensus.cc:385] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:58.960273 28609 raft_consensus.cc:740] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:55:58.961421 28609 consensus_queue.cc:260] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:58.965394 28608 consensus_queue.cc:260] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:58.971786 28609 ts_tablet_manager.cc:1434] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.081s user 0.042s sys 0.000s
I20260928 07:55:58.972925 28608 ts_tablet_manager.cc:1434] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20260928 07:55:58.976853 28608 tablet_bootstrap.cc:492] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:55:58.978328 28609 tablet_bootstrap.cc:492] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:55:58.980530 27820 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_e97da6ec4ba84945a7e55b4a764d1606"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:55:58.985615 28609 tablet_bootstrap.cc:654] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:59.002315 28608 tablet_bootstrap.cc:654] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
W20260928 07:55:59.018996 28256 tablet.cc:2433] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 07:55:59.019938 28607 tablet_bootstrap.cc:492] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:55:59.023353 28607 ts_tablet_manager.cc:1403] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.082s user 0.017s sys 0.001s
I20260928 07:55:59.027475 28607 raft_consensus.cc:359] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:59.028887 28607 raft_consensus.cc:385] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:59.029441 28607 raft_consensus.cc:740] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:55:59.030557 28607 consensus_queue.cc:260] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:59.031302 28608 tablet_bootstrap.cc:492] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:55:59.033560 28607 ts_tablet_manager.cc:1434] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.010s user 0.007s sys 0.002s
I20260928 07:55:59.034825 28607 tablet_bootstrap.cc:492] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:55:59.037770 28609 tablet_bootstrap.cc:492] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:55:59.038316 28609 ts_tablet_manager.cc:1403] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.060s user 0.019s sys 0.027s
I20260928 07:55:59.041394 28609 raft_consensus.cc:359] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.042222 28609 raft_consensus.cc:385] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:59.042614 28609 raft_consensus.cc:740] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:55:59.042946 28607 tablet_bootstrap.cc:654] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:59.043826 28609 consensus_queue.cc:260] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.051175 28609 ts_tablet_manager.cc:1434] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260928 07:55:59.052333 28609 tablet_bootstrap.cc:492] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:55:59.059209 28609 tablet_bootstrap.cc:654] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:59.031736 28608 ts_tablet_manager.cc:1403] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.055s user 0.005s sys 0.006s
I20260928 07:55:59.063832 28608 raft_consensus.cc:359] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.064541 28608 raft_consensus.cc:385] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:59.064845 28608 raft_consensus.cc:740] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:55:59.081991 28608 consensus_queue.cc:260] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.084367 28608 ts_tablet_manager.cc:1434] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260928 07:55:59.090219 28609 tablet_bootstrap.cc:492] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:55:59.090674 28609 ts_tablet_manager.cc:1403] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.011s
I20260928 07:55:59.093498 28609 raft_consensus.cc:359] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:59.094225 28609 raft_consensus.cc:385] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:59.094518 28609 raft_consensus.cc:740] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:55:59.098441 28616 raft_consensus.cc:493] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:55:59.099061 28616 raft_consensus.cc:515] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.101732 28609 consensus_queue.cc:260] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:59.105448 28616 leader_election.cc:290] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:59.108183 28609 ts_tablet_manager.cc:1434] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20260928 07:55:59.109162 28609 tablet_bootstrap.cc:492] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:55:59.115121 28607 tablet_bootstrap.cc:492] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:55:59.115607 28607 ts_tablet_manager.cc:1403] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.081s user 0.014s sys 0.012s
I20260928 07:55:59.116060 28609 tablet_bootstrap.cc:654] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:59.116725 28620 raft_consensus.cc:493] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:55:59.118439 28607 raft_consensus.cc:359] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.119169 28607 raft_consensus.cc:385] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:59.119477 28607 raft_consensus.cc:740] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:55:59.120177 28607 consensus_queue.cc:260] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.121456 28620 raft_consensus.cc:515] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:55:59.123696 28402 tablet.cc:2433] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 07:55:59.129565 28620 leader_election.cc:290] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:59.144210 28607 ts_tablet_manager.cc:1434] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260928 07:55:59.145299 28607 tablet_bootstrap.cc:492] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:55:59.159844 28607 tablet_bootstrap.cc:654] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:55:59.175707 28609 tablet_bootstrap.cc:492] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:55:59.176345 28609 ts_tablet_manager.cc:1403] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.067s user 0.007s sys 0.006s
I20260928 07:55:59.179584 28609 raft_consensus.cc:359] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.180348 28609 raft_consensus.cc:385] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:59.180662 28609 raft_consensus.cc:740] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:55:59.181447 28609 consensus_queue.cc:260] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.182202 28614 raft_consensus.cc:493] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:55:59.182749 28614 raft_consensus.cc:515] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:59.186750 28614 leader_election.cc:290] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:55:59.200393 28609 ts_tablet_manager.cc:1434] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.024s user 0.003s sys 0.004s
I20260928 07:55:59.227068 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ff57d55bcc4a33a5eb11ee87e3d461" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:55:59.228109 28351 raft_consensus.cc:2468] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:55:59.229859 28142 leader_election.cc:304] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:55:59.230834 28616 raft_consensus.cc:2804] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:55:59.231222 28616 raft_consensus.cc:493] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:55:59.231580 28616 raft_consensus.cc:3060] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.232877 28607 tablet_bootstrap.cc:492] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:55:59.233343 28607 ts_tablet_manager.cc:1403] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.088s user 0.013s sys 0.000s
I20260928 07:55:59.236152 28607 raft_consensus.cc:359] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.236855 28607 raft_consensus.cc:385] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:55:59.237149 28607 raft_consensus.cc:740] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:55:59.237944 28607 consensus_queue.cc:260] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.238658 28616 raft_consensus.cc:515] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.240733 28616 leader_election.cc:290] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:59.241515 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ff57d55bcc4a33a5eb11ee87e3d461" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:55:59.242352 28499 raft_consensus.cc:2468] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:55:59.244727 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ff57d55bcc4a33a5eb11ee87e3d461" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:55:59.245330 28351 raft_consensus.cc:3060] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.252571 28351 raft_consensus.cc:2468] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:55:59.262188 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ff57d55bcc4a33a5eb11ee87e3d461" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:55:59.262778 28499 raft_consensus.cc:3060] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.264082 28607 ts_tablet_manager.cc:1434] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20260928 07:55:59.265374 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f56b9e5701f41969d3edfa87fb95b13" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:55:59.266099 28498 raft_consensus.cc:2468] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:55:59.268883 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bd773b7b66459aab84879bae66b79e" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:55:59.269773 28207 raft_consensus.cc:2468] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:55:59.277277 28285 leader_election.cc:304] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:55:59.278568 28620 raft_consensus.cc:2804] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 07:55:59.278844 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa9c0 after lost signal to thread 27869
I20260928 07:55:59.278932 28620 raft_consensus.cc:493] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:55:59.279295 28620 raft_consensus.cc:3060] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:55:59.279587 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac120 after lost signal to thread 27938
I20260928 07:55:59.280303 28142 leader_election.cc:304] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:55:59.284099 28640 raft_consensus.cc:2804] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:55:59.284165 28434 leader_election.cc:304] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:55:59.284760 28640 raft_consensus.cc:697] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:55:59.285120 28614 raft_consensus.cc:2804] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:55:59.285503 28614 raft_consensus.cc:493] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:55:59.285823 28614 raft_consensus.cc:3060] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.286013 28640 consensus_queue.cc:237] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.287240 28499 raft_consensus.cc:2468] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:55:59.298125 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bd773b7b66459aab84879bae66b79e" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:55:59.298856 28351 raft_consensus.cc:2468] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:55:59.302753 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f56b9e5701f41969d3edfa87fb95b13" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:55:59.303598 28207 raft_consensus.cc:2468] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:55:59.307894 28620 raft_consensus.cc:515] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.309042 28614 raft_consensus.cc:515] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:59.312021 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f56b9e5701f41969d3edfa87fb95b13" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:55:59.312676 28207 raft_consensus.cc:3060] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.316772 27821 catalog_manager.cc:5838] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:55:59.333357 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bd773b7b66459aab84879bae66b79e" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:55:59.334050 28351 raft_consensus.cc:3060] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.340541 28351 raft_consensus.cc:2468] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:55:59.343991 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f56b9e5701f41969d3edfa87fb95b13" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:55:59.344580 28499 raft_consensus.cc:3060] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.351501 28499 raft_consensus.cc:2468] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:55:59.354444 28285 leader_election.cc:304] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:55:59.358074 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bd773b7b66459aab84879bae66b79e" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:55:59.358939 28206 raft_consensus.cc:3060] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.361708 28640 raft_consensus.cc:493] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:55:59.362219 28640 raft_consensus.cc:515] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.364629 28640 leader_election.cc:290] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:59.365676 28434 leader_election.cc:304] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:55:59.370142 28206 raft_consensus.cc:2468] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:55:59.373474 28620 leader_election.cc:290] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:59.374230 28620 raft_consensus.cc:2804] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:55:59.374790 28620 raft_consensus.cc:697] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:55:59.375912 28620 consensus_queue.cc:237] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.380439 28207 raft_consensus.cc:2468] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:55:59.383167 28614 leader_election.cc:290] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:55:59.383841 28614 raft_consensus.cc:2804] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:55:59.384358 28614 raft_consensus.cc:697] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:55:59.385396 28614 consensus_queue.cc:237] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:55:59.400074 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e4a03df754b9a95bc5b9107dda783" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:55:59.400832 28499 raft_consensus.cc:2468] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
W20260928 07:55:59.402083 28285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 47761.6us
I20260928 07:55:59.403972 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e4a03df754b9a95bc5b9107dda783" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:55:59.404707 28351 raft_consensus.cc:2468] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:55:59.410652 28642 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:55:59.411306 28642 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:55:59.414547 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 15 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:55:59.417209 28141 leader_election.cc:304] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:55:59.418181 28640 raft_consensus.cc:2804] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:55:59.418509 28640 raft_consensus.cc:493] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:55:59.418810 28640 raft_consensus.cc:3060] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.427850 28642 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:55:59.427029 28640 raft_consensus.cc:515] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:55:59.433540 28640 leader_election.cc:290] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:55:59.435088 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e4a03df754b9a95bc5b9107dda783" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:55:59.435851 28499 raft_consensus.cc:3060] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:55:59.444609 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e4a03df754b9a95bc5b9107dda783" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:55:59.445350 28351 raft_consensus.cc:3060] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:55:59.449841 27891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 6 similar messages]
I20260928 07:55:59.455952 28351 raft_consensus.cc:2468] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:55:59.457532 28499 raft_consensus.cc:2468] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:55:59.459286 28141 leader_election.cc:304] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:55:59.460371 28640 raft_consensus.cc:2804] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:55:59.460868 28640 raft_consensus.cc:697] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:55:59.461611 28640 consensus_queue.cc:237] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:55:59.485721 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:55:59.486349 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:55:59.487282 28642 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 07:55:59.492830 27821 catalog_manager.cc:5838] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:55:59.523128 27821 catalog_manager.cc:5838] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:55:59.526611 27822 catalog_manager.cc:5838] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260928 07:55:59.755177 27511 external_mini_cluster.cc:1372] Running /tmp/dist-test-task47VKlj/build/tsan/bin/kudu
/tmp/dist-test-task47VKlj/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.221.252:41205
--webserver_interface=127.26.221.252
--webserver_port=40429
--builtin_ntp_servers=127.26.221.212:43659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--hive_metastore_uris=thrift://127.0.0.1:33315
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 07:55:59.772630 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet 62ff57d55bcc4a33a5eb11ee87e3d461 from {username='slave'} at 127.0.0.1:51542
I20260928 07:55:59.780426 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet bc7e4a03df754b9a95bc5b9107dda783 from {username='slave'} at 127.0.0.1:51542
I20260928 07:55:59.813277 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 62ff57d55bcc4a33a5eb11ee87e3d461
I20260928 07:55:59.819591 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ff57d55bcc4a33a5eb11ee87e3d461 with delete_type TABLET_DATA_DELETED (replaced by tablet baa6dbf5dc6c40648146adde3a20761c) from {username='slave'} at 127.0.0.1:54230
I20260928 07:55:59.834841 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet bc7e4a03df754b9a95bc5b9107dda783
I20260928 07:55:59.836916 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet bc7e4a03df754b9a95bc5b9107dda783 with delete_type TABLET_DATA_DELETED (replaced by tablet 57dee1f2c67e4807a5911fd720526374) from {username='slave'} at 127.0.0.1:54230
I20260928 07:55:59.838443 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet bc7e4a03df754b9a95bc5b9107dda783 with delete_type TABLET_DATA_DELETED (replaced by tablet 57dee1f2c67e4807a5911fd720526374) from {username='slave'} at 127.0.0.1:60428
I20260928 07:55:59.840188 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet bc7e4a03df754b9a95bc5b9107dda783 with delete_type TABLET_DATA_DELETED (replaced by tablet 57dee1f2c67e4807a5911fd720526374) from {username='slave'} at 127.0.0.1:50372
I20260928 07:55:59.847640 27822 catalog_manager.cc:6934] ReplaceTablet: tablet bc7e4a03df754b9a95bc5b9107dda783 deleted and replaced by tablet 57dee1f2c67e4807a5911fd720526374
I20260928 07:55:59.849328 27826 catalog_manager.cc:3541] renamed table default.table_2cecddd82a2240278979dcdd6f8419d7 [id=1fe89d7dbd8f4ac092797bdc68966aed] in HMS: new name default.table_5554a4e3daa34b5bae576237453e3c77
I20260928 07:55:59.855355 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ff57d55bcc4a33a5eb11ee87e3d461 with delete_type TABLET_DATA_DELETED (replaced by tablet baa6dbf5dc6c40648146adde3a20761c) from {username='slave'} at 127.0.0.1:60428
I20260928 07:55:59.858196 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ff57d55bcc4a33a5eb11ee87e3d461 with delete_type TABLET_DATA_DELETED (replaced by tablet baa6dbf5dc6c40648146adde3a20761c) from {username='slave'} at 127.0.0.1:50372
W20260928 07:55:59.860056 27825 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b683bb3b8dc3479ea1bb3735c0fb55af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:55:59.863186 27824 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c9320b8b140446b882ec239e50aabb4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:55:59.865063 27823 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cf5b0809ce954e06aacdc06963219c0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:55:59.875113 28657 tablet_replica.cc:333] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:55:59.885826 28657 raft_consensus.cc:2243] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:55:59.886482 28657 raft_consensus.cc:2272] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:55:59.889026 28657 ts_tablet_manager.cc:1916] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:55:59.900749 28187 tablet_service.cc:1511] Processing CreateTablet for tablet baa6dbf5dc6c40648146adde3a20761c (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:59.901986 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa6dbf5dc6c40648146adde3a20761c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:59.912820 28329 tablet_service.cc:1511] Processing CreateTablet for tablet baa6dbf5dc6c40648146adde3a20761c (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:59.917263 28479 tablet_service.cc:1511] Processing CreateTablet for tablet baa6dbf5dc6c40648146adde3a20761c (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:59.918411 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa6dbf5dc6c40648146adde3a20761c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:59.929253 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 57dee1f2c67e4807a5911fd720526374 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:59.930393 27821 catalog_manager.cc:6934] ReplaceTablet: tablet 62ff57d55bcc4a33a5eb11ee87e3d461 deleted and replaced by tablet baa6dbf5dc6c40648146adde3a20761c
I20260928 07:55:59.930652 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dee1f2c67e4807a5911fd720526374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:59.943233 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 57dee1f2c67e4807a5911fd720526374 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:59.953902 28658 tablet_replica.cc:333] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:55:59.960007 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 57dee1f2c67e4807a5911fd720526374 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:55:59.961347 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dee1f2c67e4807a5911fd720526374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:59.966161 28656 tablet_replica.cc:333] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:55:59.971571 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dee1f2c67e4807a5911fd720526374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:59.977191 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa6dbf5dc6c40648146adde3a20761c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:55:59.994752 28662 tablet_bootstrap.cc:492] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:00.010464 28658 raft_consensus.cc:2243] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.011276 28658 raft_consensus.cc:2272] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.014540 28658 ts_tablet_manager.cc:1916] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.016950 28657 ts_tablet_manager.cc:1929] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:00.017450 28657 log.cc:1199] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/bc7e4a03df754b9a95bc5b9107dda783
I20260928 07:56:00.018275 28657 ts_tablet_manager.cc:1950] T bc7e4a03df754b9a95bc5b9107dda783 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:00.021808 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet bc7e4a03df754b9a95bc5b9107dda783 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:55:59.967417 28656 raft_consensus.cc:2243] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:00.023519 28656 pending_rounds.cc:70] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:00.023937 28656 pending_rounds.cc:77] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224524464250880 op_type: NO_OP noop_request { }
I20260928 07:56:00.024475 28656 raft_consensus.cc:2889] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:00.027642 28656 raft_consensus.cc:2272] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.046387 28662 tablet_bootstrap.cc:654] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.047714 28656 ts_tablet_manager.cc:1916] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.059207 28657 tablet_replica.cc:333] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:00.060065 28657 raft_consensus.cc:2243] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.060591 28657 raft_consensus.cc:2272] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.062613 28657 ts_tablet_manager.cc:1916] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.071239 28662 tablet_bootstrap.cc:492] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:00.071731 28662 ts_tablet_manager.cc:1403] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.007s
I20260928 07:56:00.072378 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet baa6dbf5dc6c40648146adde3a20761c from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:00.078279 28662 raft_consensus.cc:359] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.079007 28662 raft_consensus.cc:385] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.079355 28662 raft_consensus.cc:740] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.071161 28656 ts_tablet_manager.cc:1929] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:00.085543 28656 log.cc:1199] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/62ff57d55bcc4a33a5eb11ee87e3d461
I20260928 07:56:00.086669 28656 ts_tablet_manager.cc:1950] T 62ff57d55bcc4a33a5eb11ee87e3d461 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:00.090569 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 62ff57d55bcc4a33a5eb11ee87e3d461 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:00.091607 28656 tablet_replica.cc:333] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:00.092360 28656 raft_consensus.cc:2243] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:00.093146 28656 pending_rounds.cc:70] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:00.093417 28656 pending_rounds.cc:77] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224525176340480 op_type: NO_OP noop_request { }
I20260928 07:56:00.093833 28656 raft_consensus.cc:2889] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:00.094233 28656 raft_consensus.cc:2272] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.098798 28662 consensus_queue.cc:260] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.100380 28656 ts_tablet_manager.cc:1916] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.116706 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet baa6dbf5dc6c40648146adde3a20761c
I20260928 07:56:00.119987 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet baa6dbf5dc6c40648146adde3a20761c with delete_type TABLET_DATA_DELETED (replaced by tablet efa9284be7934573a74476545d813fbb) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:00.123178 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet baa6dbf5dc6c40648146adde3a20761c with delete_type TABLET_DATA_DELETED (replaced by tablet efa9284be7934573a74476545d813fbb) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:00.126123 27822 catalog_manager.cc:6934] ReplaceTablet: tablet baa6dbf5dc6c40648146adde3a20761c deleted and replaced by tablet efa9284be7934573a74476545d813fbb
I20260928 07:56:00.128860 28656 ts_tablet_manager.cc:1929] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:00.129328 28656 log.cc:1199] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/bc7e4a03df754b9a95bc5b9107dda783
I20260928 07:56:00.130141 28656 ts_tablet_manager.cc:1950] T bc7e4a03df754b9a95bc5b9107dda783 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:00.133071 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet bc7e4a03df754b9a95bc5b9107dda783 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:00.139460 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 57dee1f2c67e4807a5911fd720526374 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:00.125268 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet baa6dbf5dc6c40648146adde3a20761c with delete_type TABLET_DATA_DELETED (replaced by tablet efa9284be7934573a74476545d813fbb) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:00.149453 28666 tablet_bootstrap.cc:492] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:00.156765 28657 ts_tablet_manager.cc:1929] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 07:56:00.157016 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet baa6dbf5dc6c40648146adde3a20761c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet baa6dbf5dc6c40648146adde3a20761c already in progress: creating tablet
I20260928 07:56:00.169756 28657 log.cc:1199] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/62ff57d55bcc4a33a5eb11ee87e3d461
I20260928 07:56:00.170743 28657 ts_tablet_manager.cc:1950] T 62ff57d55bcc4a33a5eb11ee87e3d461 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:00.186831 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 62ff57d55bcc4a33a5eb11ee87e3d461 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
W20260928 07:56:00.187855 27815 catalog_manager.cc:5043] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet baa6dbf5dc6c40648146adde3a20761c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet baa6dbf5dc6c40648146adde3a20761c already in progress: creating tablet
I20260928 07:56:00.196640 28667 tablet_bootstrap.cc:492] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:00.198313 28662 ts_tablet_manager.cc:1434] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.126s user 0.006s sys 0.020s
I20260928 07:56:00.202050 28662 tablet_bootstrap.cc:492] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
W20260928 07:56:00.205956 27820 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e97da6ec4ba84945a7e55b4a764d1606 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:00.209002 28662 tablet_bootstrap.cc:654] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:00.214538 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260928 07:56:00.224591 27826 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 5) took 1942 ms. Trace:
I20260928 07:56:00.225148 27826 rpcz_store.cc:276] 0928 07:55:58.281854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:58.287923 (+ 6069us) service_pool.cc:224] Handling call
0928 07:55:58.810791 (+522868us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:00.221176 (+1410385us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:00.223351 (+ 2175us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:00.224486 (+ 1135us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":13017,"Hive Metastore.run_cpu_time_us":2404,"Hive Metastore.run_wall_time_us":1024132}
I20260928 07:56:00.243399 28666 tablet_bootstrap.cc:654] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.261896 27829 catalog_manager.cc:3541] renamed table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39] in HMS: new name default.table_6ba15b125765407a97c61d226b03034e
I20260928 07:56:00.265038 28331 tablet_service.cc:1511] Processing CreateTablet for tablet efa9284be7934573a74476545d813fbb (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.266312 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa9284be7934573a74476545d813fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.276281 28477 tablet_service.cc:1511] Processing CreateTablet for tablet efa9284be7934573a74476545d813fbb (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.276664 28666 tablet_bootstrap.cc:492] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:00.277065 28666 ts_tablet_manager.cc:1403] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.128s user 0.010s sys 0.007s
I20260928 07:56:00.277482 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa9284be7934573a74476545d813fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.279151 28186 tablet_service.cc:1511] Processing CreateTablet for tablet efa9284be7934573a74476545d813fbb (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.280915 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa9284be7934573a74476545d813fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.293690 28662 tablet_bootstrap.cc:492] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:00.294384 28662 ts_tablet_manager.cc:1403] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.093s user 0.014s sys 0.000s
I20260928 07:56:00.297479 28662 raft_consensus.cc:359] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.298503 28662 raft_consensus.cc:385] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.298799 28662 raft_consensus.cc:740] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.299671 28662 consensus_queue.cc:260] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.304131 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 57dee1f2c67e4807a5911fd720526374
I20260928 07:56:00.305930 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 57dee1f2c67e4807a5911fd720526374 deleted and replaced by tablet 8e4a2b706c47493f9bbd5f3d5aef562b
I20260928 07:56:00.306511 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 57dee1f2c67e4807a5911fd720526374 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e4a2b706c47493f9bbd5f3d5aef562b) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:00.307928 28656 tablet_replica.cc:333] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:00.308847 28656 raft_consensus.cc:2243] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.309130 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 57dee1f2c67e4807a5911fd720526374 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e4a2b706c47493f9bbd5f3d5aef562b) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:00.309470 28656 raft_consensus.cc:2272] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.314389 28656 ts_tablet_manager.cc:1916] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.315965 28662 ts_tablet_manager.cc:1434] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20260928 07:56:00.331514 28675 consensus_queue.cc:1048] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:00.345629 28206 raft_consensus.cc:1275] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Refusing update from remote peer bae11841a62f429a98a978de5b7bd60e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:00.346906 28662 tablet_bootstrap.cc:492] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
W20260928 07:56:00.314450 27815 catalog_manager.cc:5043] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet 57dee1f2c67e4807a5911fd720526374 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57dee1f2c67e4807a5911fd720526374 already in progress: creating tablet
I20260928 07:56:00.350059 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 57dee1f2c67e4807a5911fd720526374 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e4a2b706c47493f9bbd5f3d5aef562b) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:00.297417 28666 raft_consensus.cc:359] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.354643 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet baa6dbf5dc6c40648146adde3a20761c from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:00.354803 28666 raft_consensus.cc:385] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.356912 28662 tablet_bootstrap.cc:654] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.357748 28666 raft_consensus.cc:740] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.360440 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet baa6dbf5dc6c40648146adde3a20761c with delete_type TABLET_DATA_DELETED (replaced by tablet efa9284be7934573a74476545d813fbb) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:00.361815 28666 consensus_queue.cc:260] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.356916 28673 consensus_queue.cc:1048] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:00.385718 28351 raft_consensus.cc:1275] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Refusing update from remote peer bae11841a62f429a98a978de5b7bd60e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:00.367422 28666 ts_tablet_manager.cc:1434] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.090s user 0.006s sys 0.000s
I20260928 07:56:00.392288 28678 consensus_queue.cc:1048] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:00.404199 28662 tablet_bootstrap.cc:492] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:00.404748 28662 ts_tablet_manager.cc:1403] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.058s user 0.020s sys 0.001s
I20260928 07:56:00.404825 28666 tablet_bootstrap.cc:492] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:00.406849 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4a2b706c47493f9bbd5f3d5aef562b (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.407968 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4a2b706c47493f9bbd5f3d5aef562b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.415041 28662 raft_consensus.cc:359] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.421574 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4a2b706c47493f9bbd5f3d5aef562b (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.422987 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4a2b706c47493f9bbd5f3d5aef562b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.429391 28662 raft_consensus.cc:385] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.429829 28662 raft_consensus.cc:740] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.430471 28666 tablet_bootstrap.cc:654] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.430349 27826 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_5554a4e3daa34b5bae576237453e3c77" } new_table_name: "default.Table_90fcf6263808404eba291d0ffe2cc50e" modify_external_catalogs: true
I20260928 07:56:00.430677 28662 consensus_queue.cc:260] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.416110 28656 ts_tablet_manager.cc:1929] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:00.433544 28656 log.cc:1199] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/57dee1f2c67e4807a5911fd720526374
I20260928 07:56:00.434468 28656 ts_tablet_manager.cc:1950] T 57dee1f2c67e4807a5911fd720526374 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:00.441028 28674 consensus_queue.cc:1048] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:00.446563 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4a2b706c47493f9bbd5f3d5aef562b (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.447889 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4a2b706c47493f9bbd5f3d5aef562b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.454790 28667 tablet_bootstrap.cc:654] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.460781 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 57dee1f2c67e4807a5911fd720526374 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:00.461486 28662 ts_tablet_manager.cc:1434] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260928 07:56:00.462594 28662 tablet_bootstrap.cc:492] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:00.469576 28658 ts_tablet_manager.cc:1929] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:00.470075 28658 log.cc:1199] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/bc7e4a03df754b9a95bc5b9107dda783
I20260928 07:56:00.471050 28658 ts_tablet_manager.cc:1950] T bc7e4a03df754b9a95bc5b9107dda783 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:00.472414 28656 tablet_replica.cc:333] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:00.481876 28656 raft_consensus.cc:2243] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.482540 28656 raft_consensus.cc:2272] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.488456 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet bc7e4a03df754b9a95bc5b9107dda783 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:00.491452 28662 tablet_bootstrap.cc:654] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.492161 28658 tablet_replica.cc:333] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:00.494606 28667 tablet_bootstrap.cc:492] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:00.495170 28667 ts_tablet_manager.cc:1403] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.299s user 0.013s sys 0.002s
I20260928 07:56:00.495147 28656 ts_tablet_manager.cc:1916] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.510833 28658 raft_consensus.cc:2243] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.523214 27821 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 42bd773b7b66459aab84879bae66b79e (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:00.524513 28667 raft_consensus.cc:359] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.525652 28658 raft_consensus.cc:2272] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.512756 28666 tablet_bootstrap.cc:492] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:00.516570 28671 mvcc.cc:204] Tried to move back new op lower bound from 7334224528428695552 to 7334224525004460032. Current Snapshot: MvccSnapshot[applied={T|T < 7334224528428695552}]
I20260928 07:56:00.526904 28666 ts_tablet_manager.cc:1403] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.122s user 0.013s sys 0.000s
I20260928 07:56:00.526579 28692 tablet.cc:1751] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:00.527813 28667 raft_consensus.cc:385] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.530340 28666 raft_consensus.cc:359] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.531033 28666 raft_consensus.cc:385] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.531316 28666 raft_consensus.cc:740] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.538131 28667 raft_consensus.cc:740] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.539570 28658 ts_tablet_manager.cc:1916] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.543650 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 42bd773b7b66459aab84879bae66b79e from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:00.559402 28682 mvcc.cc:204] Tried to move back new op lower bound from 7334224528428695552 to 7334224525004460032. Current Snapshot: MvccSnapshot[applied={T|T < 7334224528428695552}]
I20260928 07:56:00.567836 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 42bd773b7b66459aab84879bae66b79e
I20260928 07:56:00.573294 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 42bd773b7b66459aab84879bae66b79e deleted and replaced by tablet d1adb4f2f0dc4a86a2fffabf41436e4f
I20260928 07:56:00.576824 28662 tablet_bootstrap.cc:492] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:00.577414 28662 ts_tablet_manager.cc:1403] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.115s user 0.013s sys 0.003s
I20260928 07:56:00.579180 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 42bd773b7b66459aab84879bae66b79e with delete_type TABLET_DATA_DELETED (replaced by tablet d1adb4f2f0dc4a86a2fffabf41436e4f) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:00.579952 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 42bd773b7b66459aab84879bae66b79e with delete_type TABLET_DATA_DELETED (replaced by tablet d1adb4f2f0dc4a86a2fffabf41436e4f) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:00.580758 28657 tablet_replica.cc:333] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:00.590888 28693 tablet.cc:1751] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:00.590971 28662 raft_consensus.cc:359] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.591743 28662 raft_consensus.cc:385] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.592082 28662 raft_consensus.cc:740] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.593088 28657 raft_consensus.cc:2243] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.595793 28657 raft_consensus.cc:2272] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.604193 28656 ts_tablet_manager.cc:1929] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:00.604629 28656 log.cc:1199] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/baa6dbf5dc6c40648146adde3a20761c
I20260928 07:56:00.605386 28656 ts_tablet_manager.cc:1950] T baa6dbf5dc6c40648146adde3a20761c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:00.608232 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet baa6dbf5dc6c40648146adde3a20761c (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:00.608337 28662 consensus_queue.cc:260] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.616557 28662 ts_tablet_manager.cc:1434] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.039s user 0.004s sys 0.002s
I20260928 07:56:00.631494 28186 tablet_service.cc:1511] Processing CreateTablet for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.634200 28656 tablet_replica.cc:333] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:00.635104 28656 raft_consensus.cc:2243] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.635811 28656 raft_consensus.cc:2272] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.636442 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1adb4f2f0dc4a86a2fffabf41436e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.645340 28657 ts_tablet_manager.cc:1916] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.646486 28656 ts_tablet_manager.cc:1916] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.654474 28667 consensus_queue.cc:260] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.552551 28690 tablet.cc:1751] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:00.542740 28666 consensus_queue.cc:260] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.659572 28666 ts_tablet_manager.cc:1434] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.132s user 0.004s sys 0.003s
I20260928 07:56:00.659706 28331 tablet_service.cc:1511] Processing CreateTablet for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.660684 28666 tablet_bootstrap.cc:492] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:00.660946 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1adb4f2f0dc4a86a2fffabf41436e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.662768 28673 raft_consensus.cc:493] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:00.663287 28673 raft_consensus.cc:515] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.671424 28477 tablet_service.cc:1511] Processing CreateTablet for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.672618 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1adb4f2f0dc4a86a2fffabf41436e4f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:00.673060 28434 leader_election.cc:343] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: baa6dbf5dc6c40648146adde3a20761c
I20260928 07:56:00.676769 28673 leader_election.cc:290] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:00.678565 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa6dbf5dc6c40648146adde3a20761c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:00.680248 28434 leader_election.cc:343] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:00.680721 28434 leader_election.cc:304] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:00.681563 28667 ts_tablet_manager.cc:1434] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.186s user 0.004s sys 0.003s
I20260928 07:56:00.681916 28673 raft_consensus.cc:2749] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:00.650852 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 42bd773b7b66459aab84879bae66b79e with delete_type TABLET_DATA_DELETED (replaced by tablet d1adb4f2f0dc4a86a2fffabf41436e4f) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:00.687219 28667 tablet_bootstrap.cc:492] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:00.689987 28666 tablet_bootstrap.cc:654] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.728587 28667 tablet_bootstrap.cc:654] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.731880 28666 tablet_bootstrap.cc:492] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:00.732352 28666 ts_tablet_manager.cc:1403] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.072s user 0.008s sys 0.004s
I20260928 07:56:00.735306 28666 raft_consensus.cc:359] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.735996 28666 raft_consensus.cc:385] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.736272 28666 raft_consensus.cc:740] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.737766 28662 tablet_bootstrap.cc:492] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:00.745570 28662 tablet_bootstrap.cc:654] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.754742 28662 tablet_bootstrap.cc:492] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:00.755286 28662 ts_tablet_manager.cc:1403] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.009s
I20260928 07:56:00.755635 28656 ts_tablet_manager.cc:1929] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:00.756088 28656 log.cc:1199] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/42bd773b7b66459aab84879bae66b79e
I20260928 07:56:00.729503 28657 ts_tablet_manager.cc:1929] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:00.759789 28657 log.cc:1199] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/42bd773b7b66459aab84879bae66b79e
I20260928 07:56:00.760633 28657 ts_tablet_manager.cc:1950] T 42bd773b7b66459aab84879bae66b79e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:00.763031 28656 ts_tablet_manager.cc:1950] T 42bd773b7b66459aab84879bae66b79e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:00.763729 28666 consensus_queue.cc:260] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.770041 28658 ts_tablet_manager.cc:1929] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:00.777706 28662 raft_consensus.cc:359] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.778543 28662 raft_consensus.cc:385] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.778889 28662 raft_consensus.cc:740] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.781440 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 42bd773b7b66459aab84879bae66b79e (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:00.782264 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 42bd773b7b66459aab84879bae66b79e (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:00.780362 28666 ts_tablet_manager.cc:1434] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.048s user 0.007s sys 0.001s
I20260928 07:56:00.787062 28658 log.cc:1199] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/62ff57d55bcc4a33a5eb11ee87e3d461
I20260928 07:56:00.788365 28658 ts_tablet_manager.cc:1950] T 62ff57d55bcc4a33a5eb11ee87e3d461 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:00.789693 28662 consensus_queue.cc:260] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.792532 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 57dee1f2c67e4807a5911fd720526374 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e4a2b706c47493f9bbd5f3d5aef562b) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:00.794239 28667 tablet_bootstrap.cc:492] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:00.794782 28667 ts_tablet_manager.cc:1403] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.108s user 0.012s sys 0.002s
I20260928 07:56:00.798164 28657 tablet_replica.cc:333] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:00.800549 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 62ff57d55bcc4a33a5eb11ee87e3d461 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:00.801653 28673 raft_consensus.cc:493] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:00.802111 28673 raft_consensus.cc:515] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.804251 28673 leader_election.cc:290] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:00.806617 28662 ts_tablet_manager.cc:1434] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.051s user 0.004s sys 0.003s
I20260928 07:56:00.797761 28667 raft_consensus.cc:359] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.807196 28667 raft_consensus.cc:385] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.807948 28658 tablet_replica.cc:333] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:00.808264 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee1f2c67e4807a5911fd720526374" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:00.809545 28351 raft_consensus.cc:2468] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:00.811395 28667 raft_consensus.cc:740] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.810925 28434 leader_election.cc:304] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
W20260928 07:56:00.812453 28434 leader_election.cc:343] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 57dee1f2c67e4807a5911fd720526374
I20260928 07:56:00.812541 28673 raft_consensus.cc:2804] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:00.812881 28673 raft_consensus.cc:493] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:00.813190 28673 raft_consensus.cc:3060] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:00.814428 28658 raft_consensus.cc:2243] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.815047 28667 consensus_queue.cc:260] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.816188 28658 raft_consensus.cc:2272] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.821883 28666 tablet_bootstrap.cc:492] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:00.824090 28667 ts_tablet_manager.cc:1434] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.029s user 0.003s sys 0.003s
I20260928 07:56:00.825758 28658 ts_tablet_manager.cc:1916] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.825357 28657 raft_consensus.cc:2243] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.826766 28657 raft_consensus.cc:2272] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.829932 28667 tablet_bootstrap.cc:492] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:00.841790 27821 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
W20260928 07:56:00.851224 27821 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d1adb4f2f0dc4a86a2fffabf41436e4f consensus state has no leader
I20260928 07:56:00.820914 28673 raft_consensus.cc:515] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.855997 28673 leader_election.cc:290] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:00.833570 28657 ts_tablet_manager.cc:1916] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.850871 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet baa6dbf5dc6c40648146adde3a20761c with delete_type TABLET_DATA_DELETED (replaced by tablet efa9284be7934573a74476545d813fbb) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:00.859642 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee1f2c67e4807a5911fd720526374" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
W20260928 07:56:00.862942 28434 leader_election.cc:343] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:00.863602 28434 leader_election.cc:343] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 57dee1f2c67e4807a5911fd720526374
I20260928 07:56:00.863950 28434 leader_election.cc:304] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:00.864997 28673 raft_consensus.cc:2749] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 07:56:00.868513 27821 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
W20260928 07:56:00.872632 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d1adb4f2f0dc4a86a2fffabf41436e4f consensus state has no leader
I20260928 07:56:00.854341 28666 tablet_bootstrap.cc:654] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.878636 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet efa9284be7934573a74476545d813fbb from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:00.885975 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e4a2b706c47493f9bbd5f3d5aef562b from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:00.904721 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet efa9284be7934573a74476545d813fbb
I20260928 07:56:00.904855 28666 tablet_bootstrap.cc:492] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:00.905285 28666 ts_tablet_manager.cc:1403] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.007s
I20260928 07:56:00.906872 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet efa9284be7934573a74476545d813fbb with delete_type TABLET_DATA_DELETED (replaced by tablet 8508bef44eb54c73b716d7a0472e0803) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:00.907651 28656 tablet_replica.cc:333] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:00.908501 28656 raft_consensus.cc:2243] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.908018 28666 raft_consensus.cc:359] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.908857 28666 raft_consensus.cc:385] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.909024 28656 raft_consensus.cc:2272] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.909138 28666 raft_consensus.cc:740] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.909152 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet efa9284be7934573a74476545d813fbb with delete_type TABLET_DATA_DELETED (replaced by tablet 8508bef44eb54c73b716d7a0472e0803) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:00.909973 28666 consensus_queue.cc:260] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.911070 28656 ts_tablet_manager.cc:1916] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.911324 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet efa9284be7934573a74476545d813fbb with delete_type TABLET_DATA_DELETED (replaced by tablet 8508bef44eb54c73b716d7a0472e0803) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:00.912984 27821 catalog_manager.cc:6934] ReplaceTablet: tablet efa9284be7934573a74476545d813fbb deleted and replaced by tablet 8508bef44eb54c73b716d7a0472e0803
I20260928 07:56:00.875550 28667 tablet_bootstrap.cc:654] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:00.935773 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 8e4a2b706c47493f9bbd5f3d5aef562b
I20260928 07:56:00.937687 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e4a2b706c47493f9bbd5f3d5aef562b with delete_type TABLET_DATA_DELETED (replaced by tablet 2f9c27f01a83497585e1198c108d8254) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:00.939810 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e4a2b706c47493f9bbd5f3d5aef562b with delete_type TABLET_DATA_DELETED (replaced by tablet 2f9c27f01a83497585e1198c108d8254) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:00.941888 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e4a2b706c47493f9bbd5f3d5aef562b with delete_type TABLET_DATA_DELETED (replaced by tablet 2f9c27f01a83497585e1198c108d8254) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:00.942488 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 8e4a2b706c47493f9bbd5f3d5aef562b deleted and replaced by tablet 2f9c27f01a83497585e1198c108d8254
I20260928 07:56:00.943323 28658 ts_tablet_manager.cc:1929] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:00.943729 28658 log.cc:1199] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/baa6dbf5dc6c40648146adde3a20761c
I20260928 07:56:00.944423 28658 ts_tablet_manager.cc:1950] T baa6dbf5dc6c40648146adde3a20761c P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:00.947291 28656 ts_tablet_manager.cc:1929] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:00.947713 28656 log.cc:1199] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/efa9284be7934573a74476545d813fbb
I20260928 07:56:00.948462 28656 ts_tablet_manager.cc:1950] T efa9284be7934573a74476545d813fbb P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:00.954449 28666 ts_tablet_manager.cc:1434] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.049s user 0.005s sys 0.000s
I20260928 07:56:00.955987 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet efa9284be7934573a74476545d813fbb (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:00.956552 28657 ts_tablet_manager.cc:1929] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:00.956954 28657 log.cc:1199] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/57dee1f2c67e4807a5911fd720526374
I20260928 07:56:00.957255 28656 tablet_replica.cc:333] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:00.958104 28656 raft_consensus.cc:2243] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:00.958595 28656 raft_consensus.cc:2272] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:00.961272 28656 ts_tablet_manager.cc:1916] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:00.970415 28667 tablet_bootstrap.cc:492] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:00.970963 28667 ts_tablet_manager.cc:1403] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.141s user 0.010s sys 0.001s
I20260928 07:56:00.972838 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 8508bef44eb54c73b716d7a0472e0803 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.973928 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8508bef44eb54c73b716d7a0472e0803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.973872 28667 raft_consensus.cc:359] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.974568 28667 raft_consensus.cc:385] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:00.974539 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 8508bef44eb54c73b716d7a0472e0803 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.974836 28667 raft_consensus.cc:740] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:00.975816 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8508bef44eb54c73b716d7a0472e0803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.975597 28667 consensus_queue.cc:260] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:00.972061 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 8508bef44eb54c73b716d7a0472e0803 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:00.977665 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8508bef44eb54c73b716d7a0472e0803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:00.989833 28657 ts_tablet_manager.cc:1950] T 57dee1f2c67e4807a5911fd720526374 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:00.968618 28666 tablet_bootstrap.cc:492] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:01.012027 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 57dee1f2c67e4807a5911fd720526374 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:01.013162 28657 tablet_replica.cc:333] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:01.014364 28657 raft_consensus.cc:2243] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.015017 28657 raft_consensus.cc:2272] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.016904 28667 ts_tablet_manager.cc:1434] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.046s user 0.005s sys 0.000s
I20260928 07:56:01.018571 28667 tablet_bootstrap.cc:492] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:01.022099 28673 raft_consensus.cc:493] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:01.022737 28673 raft_consensus.cc:515] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:01.028359 28434 leader_election.cc:343] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: efa9284be7934573a74476545d813fbb
I20260928 07:56:01.030061 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa9284be7934573a74476545d813fbb" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:01.030682 28351 raft_consensus.cc:2468] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:01.031917 28434 leader_election.cc:304] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:01.024950 28673 leader_election.cc:290] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:01.033073 28677 raft_consensus.cc:2804] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:01.033445 28677 raft_consensus.cc:493] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:01.033776 28677 raft_consensus.cc:3060] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:01.041370 28678 raft_consensus.cc:493] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:01.041792 28662 tablet_bootstrap.cc:492] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:01.041841 28678 raft_consensus.cc:515] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.044517 28678 leader_election.cc:290] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:01.046528 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4a2b706c47493f9bbd5f3d5aef562b" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:01.048633 28662 tablet_bootstrap.cc:654] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.049882 28666 tablet_bootstrap.cc:654] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.050210 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4a2b706c47493f9bbd5f3d5aef562b" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:01.053993 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9c27f01a83497585e1198c108d8254 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.055138 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9c27f01a83497585e1198c108d8254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.059031 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9c27f01a83497585e1198c108d8254 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.060220 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9c27f01a83497585e1198c108d8254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.065187 28657 ts_tablet_manager.cc:1916] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.040782 28677 raft_consensus.cc:515] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.084349 28658 tablet_replica.cc:333] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:01.085642 28656 ts_tablet_manager.cc:1929] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.086750 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet baa6dbf5dc6c40648146adde3a20761c (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
W20260928 07:56:01.077585 28434 leader_election.cc:343] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:01.085201 28658 raft_consensus.cc:2243] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.088275 28658 raft_consensus.cc:2272] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:01.087751 28434 leader_election.cc:343] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: Tablet not RUNNING: STOPPED
I20260928 07:56:01.090366 28434 leader_election.cc:304] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:01.091444 28678 raft_consensus.cc:2749] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:01.087021 28656 log.cc:1199] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/8e4a2b706c47493f9bbd5f3d5aef562b
I20260928 07:56:01.093004 28677 leader_election.cc:290] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:01.094388 28662 tablet_bootstrap.cc:492] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:01.094980 28662 ts_tablet_manager.cc:1403] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.002s
I20260928 07:56:01.095292 28664 raft_consensus.cc:493] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:01.095806 28664 raft_consensus.cc:515] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.085202 28667 tablet_bootstrap.cc:654] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:01.096802 28434 leader_election.cc:343] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: efa9284be7934573a74476545d813fbb
I20260928 07:56:01.095278 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa9284be7934573a74476545d813fbb" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:01.097991 28351 raft_consensus.cc:3060] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:01.098138 28664 leader_election.cc:290] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:01.097097 28656 ts_tablet_manager.cc:1950] T 8e4a2b706c47493f9bbd5f3d5aef562b P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:01.102216 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1adb4f2f0dc4a86a2fffabf41436e4f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:01.104046 28142 leader_election.cc:343] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:01.105309 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9c27f01a83497585e1198c108d8254 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.106668 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9c27f01a83497585e1198c108d8254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.109724 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 8e4a2b706c47493f9bbd5f3d5aef562b (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:01.110101 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1adb4f2f0dc4a86a2fffabf41436e4f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:01.111832 28141 leader_election.cc:343] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:01.112308 28141 leader_election.cc:304] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:01.113611 28664 raft_consensus.cc:2749] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:01.114076 28658 ts_tablet_manager.cc:1916] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.115935 28351 raft_consensus.cc:2468] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:01.104579 28662 raft_consensus.cc:359] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.116564 28662 raft_consensus.cc:385] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.122367 28434 leader_election.cc:304] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:01.123050 28662 raft_consensus.cc:740] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.123327 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 8508bef44eb54c73b716d7a0472e0803 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:01.123543 28677 raft_consensus.cc:2804] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:01.128157 28677 raft_consensus.cc:697] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:01.128993 28677 consensus_queue.cc:237] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.125365 28662 consensus_queue.cc:260] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.146499 28667 tablet_bootstrap.cc:492] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:01.146960 28667 ts_tablet_manager.cc:1403] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.129s user 0.008s sys 0.004s
I20260928 07:56:01.156016 28667 raft_consensus.cc:359] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.156742 28667 raft_consensus.cc:385] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.158102 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 8508bef44eb54c73b716d7a0472e0803 with delete_type TABLET_DATA_DELETED (replaced by tablet c4ccdaf195e64ddf88818da6b73a5aac) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:01.158442 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet d1adb4f2f0dc4a86a2fffabf41436e4f from {username='slave'} at 127.0.0.1:51542
W20260928 07:56:01.165977 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 8508bef44eb54c73b716d7a0472e0803 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8508bef44eb54c73b716d7a0472e0803 already in progress: creating tablet
I20260928 07:56:01.157048 28667 raft_consensus.cc:740] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.173733 28667 consensus_queue.cc:260] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.184242 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 8508bef44eb54c73b716d7a0472e0803
I20260928 07:56:01.143456 28662 ts_tablet_manager.cc:1434] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.048s user 0.004s sys 0.003s
I20260928 07:56:01.185369 28675 raft_consensus.cc:493] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:01.186228 28675 raft_consensus.cc:515] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.188436 28675 leader_election.cc:290] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:01.190099 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4a2b706c47493f9bbd5f3d5aef562b" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:01.190753 28499 raft_consensus.cc:2468] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:01.188366 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 8508bef44eb54c73b716d7a0472e0803 deleted and replaced by tablet c4ccdaf195e64ddf88818da6b73a5aac
I20260928 07:56:01.192853 28285 leader_election.cc:304] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:01.193706 28662 tablet_bootstrap.cc:492] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
W20260928 07:56:01.195501 28286 leader_election.cc:343] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 8e4a2b706c47493f9bbd5f3d5aef562b
I20260928 07:56:01.199416 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 8508bef44eb54c73b716d7a0472e0803 with delete_type TABLET_DATA_DELETED (replaced by tablet c4ccdaf195e64ddf88818da6b73a5aac) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:01.200203 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 8508bef44eb54c73b716d7a0472e0803 with delete_type TABLET_DATA_DELETED (replaced by tablet c4ccdaf195e64ddf88818da6b73a5aac) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:01.200974 28656 tablet_replica.cc:333] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:01.201334 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet d1adb4f2f0dc4a86a2fffabf41436e4f
I20260928 07:56:01.201668 28656 raft_consensus.cc:2243] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.202149 28656 raft_consensus.cc:2272] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.201743 28675 raft_consensus.cc:2804] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:01.204208 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet d1adb4f2f0dc4a86a2fffabf41436e4f with delete_type TABLET_DATA_DELETED (replaced by tablet 8e97445037aa466cb76e1e24d76ee6dd) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:01.204429 28675 raft_consensus.cc:493] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:01.204823 28675 raft_consensus.cc:3060] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:01.205041 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet d1adb4f2f0dc4a86a2fffabf41436e4f with delete_type TABLET_DATA_DELETED (replaced by tablet 8e97445037aa466cb76e1e24d76ee6dd) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:01.207223 28656 ts_tablet_manager.cc:1916] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.214751 28675 raft_consensus.cc:515] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.218538 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet d1adb4f2f0dc4a86a2fffabf41436e4f with delete_type TABLET_DATA_DELETED (replaced by tablet 8e97445037aa466cb76e1e24d76ee6dd) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:01.219372 28286 leader_election.cc:343] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 8e4a2b706c47493f9bbd5f3d5aef562b
I20260928 07:56:01.221030 27821 catalog_manager.cc:6934] ReplaceTablet: tablet d1adb4f2f0dc4a86a2fffabf41436e4f deleted and replaced by tablet 8e97445037aa466cb76e1e24d76ee6dd
I20260928 07:56:01.226534 28667 ts_tablet_manager.cc:1434] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.079s user 0.004s sys 0.004s
I20260928 07:56:01.228943 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4a2b706c47493f9bbd5f3d5aef562b" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:01.229566 28499 raft_consensus.cc:3060] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:01.234127 28329 tablet_service.cc:1511] Processing CreateTablet for tablet c4ccdaf195e64ddf88818da6b73a5aac (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.235332 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ccdaf195e64ddf88818da6b73a5aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.235559 28479 tablet_service.cc:1511] Processing CreateTablet for tablet c4ccdaf195e64ddf88818da6b73a5aac (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.236153 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 8508bef44eb54c73b716d7a0472e0803 with delete_type TABLET_DATA_DELETED (replaced by tablet c4ccdaf195e64ddf88818da6b73a5aac) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:01.236750 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ccdaf195e64ddf88818da6b73a5aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.238628 28185 tablet_service.cc:1511] Processing CreateTablet for tablet c4ccdaf195e64ddf88818da6b73a5aac (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.239817 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ccdaf195e64ddf88818da6b73a5aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.245769 28499 raft_consensus.cc:2468] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:01.247326 28285 leader_election.cc:304] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:01.251631 28662 tablet_bootstrap.cc:654] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.251828 28666 tablet_bootstrap.cc:492] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:01.252300 28666 ts_tablet_manager.cc:1403] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.284s user 0.007s sys 0.004s
I20260928 07:56:01.255111 28666 raft_consensus.cc:359] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.255801 28666 raft_consensus.cc:385] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.256088 28666 raft_consensus.cc:740] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.261296 28657 ts_tablet_manager.cc:1929] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.261835 28657 log.cc:1199] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/baa6dbf5dc6c40648146adde3a20761c
I20260928 07:56:01.262518 28657 ts_tablet_manager.cc:1950] T baa6dbf5dc6c40648146adde3a20761c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:01.263410 28656 ts_tablet_manager.cc:1929] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.264923 28656 log.cc:1199] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/8508bef44eb54c73b716d7a0472e0803
I20260928 07:56:01.265590 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet baa6dbf5dc6c40648146adde3a20761c (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:01.266724 28656 ts_tablet_manager.cc:1950] T 8508bef44eb54c73b716d7a0472e0803 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:01.272925 28703 raft_consensus.cc:2804] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:01.279722 28675 leader_election.cc:290] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:01.265576 28666 consensus_queue.cc:260] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.283422 28666 ts_tablet_manager.cc:1434] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.031s user 0.005s sys 0.001s
I20260928 07:56:01.290386 28667 tablet_bootstrap.cc:492] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:01.294802 28657 tablet_replica.cc:333] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:01.295642 28657 raft_consensus.cc:2243] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.296155 28657 raft_consensus.cc:2272] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.297324 28658 ts_tablet_manager.cc:1929] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.297758 28658 log.cc:1199] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/57dee1f2c67e4807a5911fd720526374
I20260928 07:56:01.298513 28658 ts_tablet_manager.cc:1950] T 57dee1f2c67e4807a5911fd720526374 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:01.301137 28657 ts_tablet_manager.cc:1916] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.306838 28703 raft_consensus.cc:697] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:01.307976 28703 consensus_queue.cc:237] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.320426 28667 tablet_bootstrap.cc:654] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.326494 28666 tablet_bootstrap.cc:492] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:01.330453 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 8e97445037aa466cb76e1e24d76ee6dd (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.331108 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 8e97445037aa466cb76e1e24d76ee6dd (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.332007 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e97445037aa466cb76e1e24d76ee6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.332393 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e97445037aa466cb76e1e24d76ee6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.333138 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 11) took 1016 ms. Trace:
I20260928 07:56:01.333559 28658 rpcz_store.cc:276] 0928 07:56:00.316364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:00.349858 (+ 33494us) service_pool.cc:224] Handling call
0928 07:56:01.084173 (+734315us) ts_tablet_manager.cc:1151] Deleting tablet 57dee1f2c67e4807a5911fd720526374
0928 07:56:01.084226 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:01.237441 (+153215us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:01.297149 (+ 59708us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:01.333061 (+ 35912us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32141,"tablet-delete.queue_time_us":733579}
I20260928 07:56:01.335650 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 57dee1f2c67e4807a5911fd720526374 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:01.336613 28658 tablet_replica.cc:333] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:01.337563 28658 raft_consensus.cc:2243] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:01.338876 28658 raft_consensus.cc:2272] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.342124 28666 tablet_bootstrap.cc:654] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.343518 28662 tablet_bootstrap.cc:492] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:01.344018 28662 ts_tablet_manager.cc:1403] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.151s user 0.011s sys 0.001s
I20260928 07:56:01.345259 28658 ts_tablet_manager.cc:1916] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.347628 28662 raft_consensus.cc:359] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.348398 28662 raft_consensus.cc:385] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.348731 28662 raft_consensus.cc:740] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.349675 28662 consensus_queue.cc:260] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.353991 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 8508bef44eb54c73b716d7a0472e0803 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:01.355203 28656 tablet_replica.cc:333] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:01.356015 28667 tablet_bootstrap.cc:492] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:01.356547 28667 ts_tablet_manager.cc:1403] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.076s user 0.009s sys 0.004s
I20260928 07:56:01.359782 28667 raft_consensus.cc:359] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.370030 28667 raft_consensus.cc:385] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.370427 28667 raft_consensus.cc:740] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.371588 28662 ts_tablet_manager.cc:1434] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.027s user 0.003s sys 0.004s
I20260928 07:56:01.369624 28657 ts_tablet_manager.cc:1929] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.372107 28657 log.cc:1199] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/efa9284be7934573a74476545d813fbb
I20260928 07:56:01.372933 28657 ts_tablet_manager.cc:1950] T efa9284be7934573a74476545d813fbb P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:01.371548 28667 consensus_queue.cc:260] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.375864 28666 tablet_bootstrap.cc:492] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:01.376327 28666 ts_tablet_manager.cc:1403] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.005s
I20260928 07:56:01.379472 28656 raft_consensus.cc:2243] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.379983 28656 raft_consensus.cc:2272] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.381726 28656 ts_tablet_manager.cc:1916] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.386077 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 8e97445037aa466cb76e1e24d76ee6dd (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.387238 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e97445037aa466cb76e1e24d76ee6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.388548 28667 ts_tablet_manager.cc:1434] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260928 07:56:01.379722 28666 raft_consensus.cc:359] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.389767 28666 raft_consensus.cc:385] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.390089 28666 raft_consensus.cc:740] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.390925 28666 consensus_queue.cc:260] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.391770 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet efa9284be7934573a74476545d813fbb (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:01.401034 28667 tablet_bootstrap.cc:492] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:01.410221 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet 2f56b9e5701f41969d3edfa87fb95b13 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:01.412617 28666 ts_tablet_manager.cc:1434] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.036s user 0.007s sys 0.001s
I20260928 07:56:01.426337 28666 tablet_bootstrap.cc:492] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:01.402688 28657 tablet_replica.cc:333] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:01.432775 28666 tablet_bootstrap.cc:654] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.435204 28675 raft_consensus.cc:493] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:01.435657 28675 raft_consensus.cc:515] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.437675 28675 leader_election.cc:290] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:01.440310 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1adb4f2f0dc4a86a2fffabf41436e4f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:01.441077 28499 raft_consensus.cc:2468] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:01.441133 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1adb4f2f0dc4a86a2fffabf41436e4f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:01.442691 28285 leader_election.cc:304] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
W20260928 07:56:01.443547 28286 leader_election.cc:343] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: Tablet not RUNNING: STOPPED
I20260928 07:56:01.446098 28675 raft_consensus.cc:2804] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:01.446560 28675 raft_consensus.cc:493] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:01.447001 28675 raft_consensus.cc:3060] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:01.452895 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 2f56b9e5701f41969d3edfa87fb95b13
I20260928 07:56:01.454926 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f56b9e5701f41969d3edfa87fb95b13 with delete_type TABLET_DATA_DELETED (replaced by tablet 002fa916faa3453798288b9d53857b57) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:01.455269 28658 ts_tablet_manager.cc:1929] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:01.455662 28658 log.cc:1199] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/42bd773b7b66459aab84879bae66b79e
I20260928 07:56:01.457304 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f56b9e5701f41969d3edfa87fb95b13 with delete_type TABLET_DATA_DELETED (replaced by tablet 002fa916faa3453798288b9d53857b57) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:01.457774 28658 ts_tablet_manager.cc:1950] T 42bd773b7b66459aab84879bae66b79e P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:01.456882 28657 raft_consensus.cc:2243] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:01.460237 27821 catalog_manager.cc:6934] ReplaceTablet: tablet 2f56b9e5701f41969d3edfa87fb95b13 deleted and replaced by tablet 002fa916faa3453798288b9d53857b57
I20260928 07:56:01.460333 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f56b9e5701f41969d3edfa87fb95b13 with delete_type TABLET_DATA_DELETED (replaced by tablet 002fa916faa3453798288b9d53857b57) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:01.474212 28662 tablet_bootstrap.cc:492] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:01.474655 28658 tablet_replica.cc:333] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:01.475423 28658 raft_consensus.cc:2243] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:01.476244 28658 pending_rounds.cc:70] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Trying to abort 1 pending ops.
I20260928 07:56:01.476619 28658 pending_rounds.cc:77] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224531994329088 op_type: NO_OP noop_request { }
I20260928 07:56:01.477135 28658 raft_consensus.cc:2889] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:01.477672 28658 raft_consensus.cc:2272] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.479848 28657 pending_rounds.cc:70] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 1 pending ops.
I20260928 07:56:01.480161 28657 pending_rounds.cc:77] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224532746641408 op_type: NO_OP noop_request { }
I20260928 07:56:01.480559 28657 raft_consensus.cc:2889] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:01.482818 28657 raft_consensus.cc:2272] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.485401 28675 raft_consensus.cc:515] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.487872 28658 ts_tablet_manager.cc:1916] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.488449 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1adb4f2f0dc4a86a2fffabf41436e4f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
W20260928 07:56:01.490127 28286 leader_election.cc:343] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: Tablet not RUNNING: STOPPED
I20260928 07:56:01.500375 28662 tablet_bootstrap.cc:654] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.500358 28657 ts_tablet_manager.cc:1916] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.474013 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 42bd773b7b66459aab84879bae66b79e (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:01.527693 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1adb4f2f0dc4a86a2fffabf41436e4f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:01.528458 28499 raft_consensus.cc:3060] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:01.533583 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet d1adb4f2f0dc4a86a2fffabf41436e4f from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:01.537947 28499 raft_consensus.cc:2468] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:01.539417 28285 leader_election.cc:304] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:01.540431 28705 raft_consensus.cc:2804] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:01.540895 28705 raft_consensus.cc:697] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:01.541829 28705 consensus_queue.cc:237] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.549690 28664 raft_consensus.cc:493] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:01.550184 28664 raft_consensus.cc:515] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.552362 28662 tablet_bootstrap.cc:492] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:01.552294 28664 leader_election.cc:290] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:01.553061 28662 ts_tablet_manager.cc:1403] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.004s
I20260928 07:56:01.554677 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9c27f01a83497585e1198c108d8254" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:01.556273 28141 leader_election.cc:343] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:01.559283 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9c27f01a83497585e1198c108d8254" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:01.560089 28658 ts_tablet_manager.cc:1929] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:01.560472 28658 log.cc:1199] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/efa9284be7934573a74476545d813fbb
W20260928 07:56:01.561673 28142 leader_election.cc:343] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:01.560251 28662 raft_consensus.cc:359] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.562104 28142 leader_election.cc:304] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:01.564428 28664 raft_consensus.cc:2749] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:01.564713 28675 leader_election.cc:290] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:01.565155 28658 ts_tablet_manager.cc:1950] T efa9284be7934573a74476545d813fbb P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:01.565150 28662 raft_consensus.cc:385] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.566442 28662 raft_consensus.cc:740] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.568882 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet efa9284be7934573a74476545d813fbb (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:01.569866 28662 consensus_queue.cc:260] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.570176 28666 tablet_bootstrap.cc:492] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:01.563429 28656 ts_tablet_manager.cc:1929] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.570734 28656 log.cc:1199] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/d1adb4f2f0dc4a86a2fffabf41436e4f
I20260928 07:56:01.570757 28666 ts_tablet_manager.cc:1403] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.145s user 0.018s sys 0.012s
I20260928 07:56:01.571470 28656 ts_tablet_manager.cc:1950] T d1adb4f2f0dc4a86a2fffabf41436e4f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:01.574079 28666 raft_consensus.cc:359] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.574826 28666 raft_consensus.cc:385] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.575213 28666 raft_consensus.cc:740] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.581622 28658 tablet_replica.cc:333] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:01.581399 28666 consensus_queue.cc:260] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.583587 28666 ts_tablet_manager.cc:1434] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.013s user 0.004s sys 0.001s
I20260928 07:56:01.587309 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 002fa916faa3453798288b9d53857b57 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.588505 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002fa916faa3453798288b9d53857b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.588670 28658 raft_consensus.cc:2243] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.589250 28658 raft_consensus.cc:2272] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.591159 28658 ts_tablet_manager.cc:1916] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.593149 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:01.496248 28667 tablet_bootstrap.cc:654] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.593359 28662 ts_tablet_manager.cc:1434] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.040s user 0.006s sys 0.000s
I20260928 07:56:01.612200 28662 tablet_bootstrap.cc:492] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:01.612931 28656 tablet_replica.cc:333] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:01.617877 28656 raft_consensus.cc:2243] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.617982 28666 tablet_bootstrap.cc:492] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:01.622030 28656 raft_consensus.cc:2272] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.624096 28656 ts_tablet_manager.cc:1916] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.624233 28666 tablet_bootstrap.cc:654] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.629240 28662 tablet_bootstrap.cc:654] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.636144 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 002fa916faa3453798288b9d53857b57 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.637253 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002fa916faa3453798288b9d53857b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.651274 28662 tablet_bootstrap.cc:492] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:01.651788 28662 ts_tablet_manager.cc:1403] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.001s
I20260928 07:56:01.653156 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 002fa916faa3453798288b9d53857b57 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.655395 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002fa916faa3453798288b9d53857b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.655779 28658 ts_tablet_manager.cc:1929] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.656128 28658 log.cc:1199] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/8e4a2b706c47493f9bbd5f3d5aef562b
I20260928 07:56:01.661671 28658 ts_tablet_manager.cc:1950] T 8e4a2b706c47493f9bbd5f3d5aef562b P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:01.664371 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 8e4a2b706c47493f9bbd5f3d5aef562b (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:01.667081 28666 tablet_bootstrap.cc:492] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:01.667565 28666 ts_tablet_manager.cc:1403] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.009s
I20260928 07:56:01.670312 28666 raft_consensus.cc:359] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.671200 28666 raft_consensus.cc:385] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.671502 28666 raft_consensus.cc:740] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.671339 28662 raft_consensus.cc:359] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.671962 28662 raft_consensus.cc:385] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.672222 28662 raft_consensus.cc:740] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.672729 28666 consensus_queue.cc:260] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.672955 28662 consensus_queue.cc:260] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.673664 28658 tablet_replica.cc:333] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:01.674551 28658 raft_consensus.cc:2243] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.677371 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 2f9c27f01a83497585e1198c108d8254 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:01.684185 27821 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:01.687355 28658 raft_consensus.cc:2272] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.686545 28666 ts_tablet_manager.cc:1434] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260928 07:56:01.692251 28657 ts_tablet_manager.cc:1929] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:01.692646 28657 log.cc:1199] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/8e4a2b706c47493f9bbd5f3d5aef562b
I20260928 07:56:01.693444 28657 ts_tablet_manager.cc:1950] T 8e4a2b706c47493f9bbd5f3d5aef562b P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:01.696063 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 8e4a2b706c47493f9bbd5f3d5aef562b (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:01.697482 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 2f9c27f01a83497585e1198c108d8254
W20260928 07:56:01.698282 27815 catalog_manager.cc:5043] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet 8508bef44eb54c73b716d7a0472e0803 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8508bef44eb54c73b716d7a0472e0803 already in progress: creating tablet
I20260928 07:56:01.698927 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 2f9c27f01a83497585e1198c108d8254 deleted and replaced by tablet 2188651a70264d7f876713e184a5bedb
I20260928 07:56:01.699343 28666 tablet_bootstrap.cc:492] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:01.701609 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f9c27f01a83497585e1198c108d8254 with delete_type TABLET_DATA_DELETED (replaced by tablet 2188651a70264d7f876713e184a5bedb) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:01.702430 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f9c27f01a83497585e1198c108d8254 with delete_type TABLET_DATA_DELETED (replaced by tablet 2188651a70264d7f876713e184a5bedb) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:01.703052 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f9c27f01a83497585e1198c108d8254 with delete_type TABLET_DATA_DELETED (replaced by tablet 2188651a70264d7f876713e184a5bedb) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:01.704052 28657 tablet_replica.cc:333] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:01.704447 28658 ts_tablet_manager.cc:1916] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.704854 28657 raft_consensus.cc:2243] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:01.705567 28657 pending_rounds.cc:70] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 1 pending ops.
I20260928 07:56:01.705857 28657 pending_rounds.cc:77] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224533760438272 op_type: NO_OP noop_request { }
I20260928 07:56:01.706266 28657 raft_consensus.cc:2889] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:01.708376 28662 ts_tablet_manager.cc:1434] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.056s user 0.005s sys 0.000s
I20260928 07:56:01.711802 28666 tablet_bootstrap.cc:654] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:01.713435 27821 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8e97445037aa466cb76e1e24d76ee6dd consensus state has no leader
I20260928 07:56:01.706640 28657 raft_consensus.cc:2272] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.738808 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 2188651a70264d7f876713e184a5bedb (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.739939 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2188651a70264d7f876713e184a5bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.744469 28657 ts_tablet_manager.cc:1916] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.747814 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet 002fa916faa3453798288b9d53857b57 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:01.759610 28667 tablet_bootstrap.cc:492] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:01.759608 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 2188651a70264d7f876713e184a5bedb (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.760125 28667 ts_tablet_manager.cc:1403] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.359s user 0.002s sys 0.013s
I20260928 07:56:01.760912 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2188651a70264d7f876713e184a5bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.765688 28667 raft_consensus.cc:359] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.767000 28662 tablet_bootstrap.cc:492] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:01.769260 28667 raft_consensus.cc:385] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.769605 28667 raft_consensus.cc:740] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.770442 28667 consensus_queue.cc:260] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.774178 28656 ts_tablet_manager.cc:1929] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:01.774544 28656 log.cc:1199] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/2f56b9e5701f41969d3edfa87fb95b13
I20260928 07:56:01.775353 28656 ts_tablet_manager.cc:1950] T 2f56b9e5701f41969d3edfa87fb95b13 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:01.773042 28667 ts_tablet_manager.cc:1434] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.013s user 0.003s sys 0.004s
I20260928 07:56:01.777928 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 2f56b9e5701f41969d3edfa87fb95b13 (table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:01.778339 28667 tablet_bootstrap.cc:492] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:01.789690 28656 tablet_replica.cc:333] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:01.790339 28656 raft_consensus.cc:2243] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.790747 28656 raft_consensus.cc:2272] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.791448 28662 tablet_bootstrap.cc:654] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.792989 28666 tablet_bootstrap.cc:492] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:01.793483 28666 ts_tablet_manager.cc:1403] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.095s user 0.012s sys 0.002s
I20260928 07:56:01.795636 28656 ts_tablet_manager.cc:1916] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.796147 28666 raft_consensus.cc:359] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.796810 28666 raft_consensus.cc:385] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.797082 28666 raft_consensus.cc:740] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.773157 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:01.806025 28658 ts_tablet_manager.cc:1929] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.806454 28658 log.cc:1199] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/d1adb4f2f0dc4a86a2fffabf41436e4f
I20260928 07:56:01.807551 28666 consensus_queue.cc:260] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.808743 28662 tablet_bootstrap.cc:492] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:01.809183 28662 ts_tablet_manager.cc:1403] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.003s
I20260928 07:56:01.811719 28662 raft_consensus.cc:359] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.812359 28662 raft_consensus.cc:385] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.812623 28662 raft_consensus.cc:740] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.816953 28667 tablet_bootstrap.cc:654] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.821318 28662 consensus_queue.cc:260] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.825316 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 8508bef44eb54c73b716d7a0472e0803 with delete_type TABLET_DATA_DELETED (replaced by tablet c4ccdaf195e64ddf88818da6b73a5aac) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:01.821702 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 002fa916faa3453798288b9d53857b57
I20260928 07:56:01.828681 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 002fa916faa3453798288b9d53857b57 with delete_type TABLET_DATA_DELETED (replaced by tablet d97a4439c50f4c8e98baef9e98bb31d6) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:01.831010 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 002fa916faa3453798288b9d53857b57 with delete_type TABLET_DATA_DELETED (replaced by tablet d97a4439c50f4c8e98baef9e98bb31d6) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:01.835494 28662 ts_tablet_manager.cc:1434] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20260928 07:56:01.838444 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 002fa916faa3453798288b9d53857b57 with delete_type TABLET_DATA_DELETED (replaced by tablet d97a4439c50f4c8e98baef9e98bb31d6) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:01.839440 28662 tablet_bootstrap.cc:492] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:01.839804 27821 catalog_manager.cc:6934] ReplaceTablet: tablet 002fa916faa3453798288b9d53857b57 deleted and replaced by tablet d97a4439c50f4c8e98baef9e98bb31d6
I20260928 07:56:01.849567 28666 ts_tablet_manager.cc:1434] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.056s user 0.007s sys 0.000s
I20260928 07:56:01.859439 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 2188651a70264d7f876713e184a5bedb (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.860836 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2188651a70264d7f876713e184a5bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.863655 28656 ts_tablet_manager.cc:1929] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.864082 28656 log.cc:1199] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/2f9c27f01a83497585e1198c108d8254
I20260928 07:56:01.864789 28656 ts_tablet_manager.cc:1950] T 2f9c27f01a83497585e1198c108d8254 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:01.807147 28658 ts_tablet_manager.cc:1950] T d1adb4f2f0dc4a86a2fffabf41436e4f P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:01.867393 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 2f9c27f01a83497585e1198c108d8254 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:01.865850 28666 tablet_bootstrap.cc:492] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:01.871927 28186 tablet_service.cc:1511] Processing CreateTablet for tablet d97a4439c50f4c8e98baef9e98bb31d6 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.872931 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97a4439c50f4c8e98baef9e98bb31d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.873108 28331 tablet_service.cc:1511] Processing CreateTablet for tablet d97a4439c50f4c8e98baef9e98bb31d6 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.874433 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97a4439c50f4c8e98baef9e98bb31d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.877974 28479 tablet_service.cc:1511] Processing CreateTablet for tablet d97a4439c50f4c8e98baef9e98bb31d6 (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:01.879182 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97a4439c50f4c8e98baef9e98bb31d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:01.881990 28656 tablet_replica.cc:333] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:01.882674 28656 raft_consensus.cc:2243] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.883111 28656 raft_consensus.cc:2272] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.883111 28677 raft_consensus.cc:493] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:01.883837 28677 raft_consensus.cc:515] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.885282 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:01.885838 28677 leader_election.cc:290] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:01.886371 28658 tablet_replica.cc:333] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:01.887091 28658 raft_consensus.cc:2243] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:01.887542 28658 raft_consensus.cc:2272] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:01.889648 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9c27f01a83497585e1198c108d8254" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:01.891506 28434 leader_election.cc:343] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 2f9c27f01a83497585e1198c108d8254
W20260928 07:56:01.892162 28434 leader_election.cc:343] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:01.892491 28434 leader_election.cc:304] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:01.895712 28666 tablet_bootstrap.cc:654] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.896159 28677 raft_consensus.cc:2749] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:01.901101 28664 raft_consensus.cc:493] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:01.901615 28664 raft_consensus.cc:515] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.902130 28662 tablet_bootstrap.cc:654] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.903662 28664 leader_election.cc:290] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:01.905611 28656 ts_tablet_manager.cc:1916] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.909847 28658 ts_tablet_manager.cc:1916] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:01.910447 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e97445037aa466cb76e1e24d76ee6dd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:01.911899 28142 leader_election.cc:343] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:01.913203 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e97445037aa466cb76e1e24d76ee6dd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:01.913883 28499 raft_consensus.cc:2468] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:01.915413 28141 leader_election.cc:304] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:01.916488 28664 raft_consensus.cc:2804] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:01.916805 28664 raft_consensus.cc:493] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:01.917110 28664 raft_consensus.cc:3060] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:01.921628 27816 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8e97445037aa466cb76e1e24d76ee6dd consensus state has no leader
I20260928 07:56:01.925531 28664 raft_consensus.cc:515] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.927644 28662 tablet_bootstrap.cc:492] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:01.928081 28662 ts_tablet_manager.cc:1403] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.092s user 0.010s sys 0.000s
I20260928 07:56:01.902042 27822 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:01.929603 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e97445037aa466cb76e1e24d76ee6dd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:01.930169 28499 raft_consensus.cc:3060] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:01.930696 28662 raft_consensus.cc:359] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.931341 28662 raft_consensus.cc:385] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.931592 28662 raft_consensus.cc:740] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.934940 28667 tablet_bootstrap.cc:492] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:01.935393 28667 ts_tablet_manager.cc:1403] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.157s user 0.001s sys 0.010s
I20260928 07:56:01.936769 28499 raft_consensus.cc:2468] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:01.937587 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e97445037aa466cb76e1e24d76ee6dd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:01.937513 28662 consensus_queue.cc:260] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:01.938889 28142 leader_election.cc:343] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:01.942256 28667 raft_consensus.cc:359] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.943197 28667 raft_consensus.cc:385] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.943547 28667 raft_consensus.cc:740] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:01.944525 28667 consensus_queue.cc:260] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.952131 28662 ts_tablet_manager.cc:1434] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.024s user 0.004s sys 0.004s
I20260928 07:56:01.955261 28662 tablet_bootstrap.cc:492] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:01.958446 28664 leader_election.cc:290] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:01.966979 28141 leader_election.cc:304] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:01.969063 28656 ts_tablet_manager.cc:1929] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:01.973942 28666 tablet_bootstrap.cc:492] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:01.974401 28666 ts_tablet_manager.cc:1403] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.114s user 0.010s sys 0.000s
I20260928 07:56:01.974825 28656 log.cc:1199] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/002fa916faa3453798288b9d53857b57
I20260928 07:56:01.976315 28656 ts_tablet_manager.cc:1950] T 002fa916faa3453798288b9d53857b57 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:01.978655 28667 ts_tablet_manager.cc:1434] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.043s user 0.007s sys 0.001s
I20260928 07:56:01.981362 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 002fa916faa3453798288b9d53857b57 (table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:01.983821 28662 tablet_bootstrap.cc:654] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:01.986279 27821 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:01.987727 28664 raft_consensus.cc:2804] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:01.988309 28664 raft_consensus.cc:697] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:01.989202 28664 consensus_queue.cc:237] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.992623 28667 tablet_bootstrap.cc:492] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:01.976967 28666 raft_consensus.cc:359] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:01.997725 28666 raft_consensus.cc:385] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:01.998025 28666 raft_consensus.cc:740] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.000588 28705 raft_consensus.cc:493] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:02.001041 28705 raft_consensus.cc:515] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.003086 28705 leader_election.cc:290] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.004320 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8508bef44eb54c73b716d7a0472e0803" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:02.005869 28285 leader_election.cc:343] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: Tablet not RUNNING: STOPPED
W20260928 07:56:02.006352 28286 leader_election.cc:343] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 8508bef44eb54c73b716d7a0472e0803
I20260928 07:56:02.006891 28662 tablet_bootstrap.cc:492] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:02.006745 28286 leader_election.cc:304] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:02.007295 28662 ts_tablet_manager.cc:1403] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.054s user 0.009s sys 0.000s
I20260928 07:56:02.008070 28705 raft_consensus.cc:2749] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:02.009308 28666 consensus_queue.cc:260] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.025782 28666 ts_tablet_manager.cc:1434] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.051s user 0.007s sys 0.000s
I20260928 07:56:02.030383 28662 raft_consensus.cc:359] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.031088 28662 raft_consensus.cc:385] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.031369 28662 raft_consensus.cc:740] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.039613 28666 tablet_bootstrap.cc:492] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:02.042018 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet 2188651a70264d7f876713e184a5bedb from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:02.043701 28662 consensus_queue.cc:260] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.046314 28662 ts_tablet_manager.cc:1434] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.039s user 0.008s sys 0.001s
I20260928 07:56:02.047185 28657 ts_tablet_manager.cc:1929] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:02.047698 28657 log.cc:1199] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/d1adb4f2f0dc4a86a2fffabf41436e4f
I20260928 07:56:02.048592 28657 ts_tablet_manager.cc:1950] T d1adb4f2f0dc4a86a2fffabf41436e4f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:02.060586 28658 ts_tablet_manager.cc:1929] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:02.074210 28667 tablet_bootstrap.cc:654] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.091895 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 2188651a70264d7f876713e184a5bedb
I20260928 07:56:02.091887 28664 raft_consensus.cc:493] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:02.092343 28664 raft_consensus.cc:515] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:02.096237 28142 leader_election.cc:343] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 2188651a70264d7f876713e184a5bedb
I20260928 07:56:02.097188 28664 leader_election.cc:290] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.104019 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:02.106285 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 2188651a70264d7f876713e184a5bedb with delete_type TABLET_DATA_DELETED (replaced by tablet d2e295d50f83468184bb8edd29738907) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:02.106580 28657 tablet_replica.cc:333] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:02.106988 28656 tablet_replica.cc:333] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:02.107684 28656 raft_consensus.cc:2243] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:02.108124 28656 raft_consensus.cc:2272] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.108747 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 2188651a70264d7f876713e184a5bedb with delete_type TABLET_DATA_DELETED (replaced by tablet d2e295d50f83468184bb8edd29738907) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:02.090443 28666 tablet_bootstrap.cc:654] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.098444 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188651a70264d7f876713e184a5bedb" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:02.110463 28656 ts_tablet_manager.cc:1916] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:02.110989 28141 leader_election.cc:343] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:02.111491 28141 leader_election.cc:304] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
W20260928 07:56:02.112128 28141 raft_consensus.cc:2686] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 07:56:02.091148 28658 log.cc:1199] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/8508bef44eb54c73b716d7a0472e0803
I20260928 07:56:02.113900 28658 ts_tablet_manager.cc:1950] T 8508bef44eb54c73b716d7a0472e0803 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:02.118000 27821 catalog_manager.cc:6934] ReplaceTablet: tablet 2188651a70264d7f876713e184a5bedb deleted and replaced by tablet d2e295d50f83468184bb8edd29738907
I20260928 07:56:02.119089 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 2188651a70264d7f876713e184a5bedb with delete_type TABLET_DATA_DELETED (replaced by tablet d2e295d50f83468184bb8edd29738907) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:02.120612 28657 raft_consensus.cc:2243] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:02.121639 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 8508bef44eb54c73b716d7a0472e0803 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:02.122747 28658 tablet_replica.cc:333] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:02.116763 27822 catalog_manager.cc:5838] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:02.125085 28657 raft_consensus.cc:2272] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.123203 28666 tablet_bootstrap.cc:492] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:02.128017 28666 ts_tablet_manager.cc:1403] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.089s user 0.008s sys 0.004s
I20260928 07:56:02.128738 28658 raft_consensus.cc:2243] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:02.129113 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:02.129798 28667 tablet_bootstrap.cc:492] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:02.130249 28667 ts_tablet_manager.cc:1403] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.138s user 0.008s sys 0.004s
I20260928 07:56:02.130762 28658 raft_consensus.cc:2272] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.132555 28667 raft_consensus.cc:359] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.133148 28667 raft_consensus.cc:385] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.133457 28667 raft_consensus.cc:740] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.135311 28658 ts_tablet_manager.cc:1916] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:02.136590 28657 ts_tablet_manager.cc:1916] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:02.143002 28656 ts_tablet_manager.cc:1929] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:02.143385 28656 log.cc:1199] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/2188651a70264d7f876713e184a5bedb
I20260928 07:56:02.143978 28656 ts_tablet_manager.cc:1950] T 2188651a70264d7f876713e184a5bedb P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:02.146488 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 2188651a70264d7f876713e184a5bedb (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:02.140272 28667 consensus_queue.cc:260] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.158038 28667 ts_tablet_manager.cc:1434] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260928 07:56:02.158959 28667 tablet_bootstrap.cc:492] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:02.168665 28667 tablet_bootstrap.cc:654] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.193485 28186 tablet_service.cc:1511] Processing CreateTablet for tablet d2e295d50f83468184bb8edd29738907 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.194525 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e295d50f83468184bb8edd29738907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:02.214188 28329 tablet_service.cc:1511] Processing CreateTablet for tablet d2e295d50f83468184bb8edd29738907 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.233004 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e295d50f83468184bb8edd29738907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:02.130487 28666 raft_consensus.cc:359] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.237462 28666 raft_consensus.cc:385] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.237798 28666 raft_consensus.cc:740] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.238517 28666 consensus_queue.cc:260] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.240551 28666 ts_tablet_manager.cc:1434] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.112s user 0.001s sys 0.004s
I20260928 07:56:02.198942 28479 tablet_service.cc:1511] Processing CreateTablet for tablet d2e295d50f83468184bb8edd29738907 (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.242076 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e295d50f83468184bb8edd29738907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:02.261556 28666 tablet_bootstrap.cc:492] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:02.270802 28666 tablet_bootstrap.cc:654] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.299314 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e97445037aa466cb76e1e24d76ee6dd from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:02.305539 28667 tablet_bootstrap.cc:492] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:02.306007 28667 ts_tablet_manager.cc:1403] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.147s user 0.010s sys 0.000s
I20260928 07:56:02.307075 28666 tablet_bootstrap.cc:492] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:02.307578 28666 ts_tablet_manager.cc:1403] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.017s
I20260928 07:56:02.308543 28667 raft_consensus.cc:359] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.309996 28666 raft_consensus.cc:359] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.311565 28662 tablet_bootstrap.cc:492] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:02.312052 28664 raft_consensus.cc:493] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:02.312485 28664 raft_consensus.cc:515] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.314435 28664 leader_election.cc:290] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.310650 28666 raft_consensus.cc:385] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.316385 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccdaf195e64ddf88818da6b73a5aac" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:02.316684 28666 raft_consensus.cc:740] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.317032 28499 raft_consensus.cc:2468] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:02.316520 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccdaf195e64ddf88818da6b73a5aac" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:02.317593 28662 tablet_bootstrap.cc:654] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.317936 28351 raft_consensus.cc:2468] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:02.317529 28666 consensus_queue.cc:260] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.309212 28667 raft_consensus.cc:385] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.319064 28142 leader_election.cc:304] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:02.319332 28667 raft_consensus.cc:740] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.319957 28667 consensus_queue.cc:260] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.321018 28664 raft_consensus.cc:2804] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:02.321394 28664 raft_consensus.cc:493] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:02.321708 28664 raft_consensus.cc:3060] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:02.328963 28667 ts_tablet_manager.cc:1434] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260928 07:56:02.329993 28667 tablet_bootstrap.cc:492] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:02.343737 28667 tablet_bootstrap.cc:654] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.344509 28664 raft_consensus.cc:515] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.355335 28666 ts_tablet_manager.cc:1434] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20260928 07:56:02.359795 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccdaf195e64ddf88818da6b73a5aac" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:02.360374 28351 raft_consensus.cc:3060] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:02.367429 28351 raft_consensus.cc:2468] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:02.368820 28142 leader_election.cc:304] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:02.369884 28721 raft_consensus.cc:2804] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:02.387159 28666 tablet_bootstrap.cc:492] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:02.390344 28664 leader_election.cc:290] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.389371 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccdaf195e64ddf88818da6b73a5aac" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:02.391149 28499 raft_consensus.cc:3060] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:02.394272 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 8e97445037aa466cb76e1e24d76ee6dd
I20260928 07:56:02.397693 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e97445037aa466cb76e1e24d76ee6dd with delete_type TABLET_DATA_DELETED (replaced by tablet f21e8b5dc66f42109f6484aa6908c9be) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:02.398183 28499 raft_consensus.cc:2468] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:02.399857 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e97445037aa466cb76e1e24d76ee6dd with delete_type TABLET_DATA_DELETED (replaced by tablet f21e8b5dc66f42109f6484aa6908c9be) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:02.396422 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e97445037aa466cb76e1e24d76ee6dd with delete_type TABLET_DATA_DELETED (replaced by tablet f21e8b5dc66f42109f6484aa6908c9be) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:02.402746 28656 tablet_replica.cc:333] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:02.403414 28656 raft_consensus.cc:2243] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:02.404112 28656 pending_rounds.cc:70] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:02.404325 28656 pending_rounds.cc:77] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224535652909056 op_type: NO_OP noop_request { }
I20260928 07:56:02.404688 28656 raft_consensus.cc:2889] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:02.404994 28656 raft_consensus.cc:2272] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.411378 28721 raft_consensus.cc:697] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:02.412448 28721 consensus_queue.cc:237] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.422551 28666 tablet_bootstrap.cc:654] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.422956 28667 tablet_bootstrap.cc:492] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:02.423424 28662 tablet_bootstrap.cc:492] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:02.423465 28667 ts_tablet_manager.cc:1403] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.094s user 0.022s sys 0.003s
I20260928 07:56:02.423851 28662 ts_tablet_manager.cc:1403] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.112s user 0.020s sys 0.024s
I20260928 07:56:02.425904 28667 raft_consensus.cc:359] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.426537 28667 raft_consensus.cc:385] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.426815 28667 raft_consensus.cc:740] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.426780 28662 raft_consensus.cc:359] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.427392 28662 raft_consensus.cc:385] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.427650 28662 raft_consensus.cc:740] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.427536 28667 consensus_queue.cc:260] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.428359 28662 consensus_queue.cc:260] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.430188 28662 ts_tablet_manager.cc:1434] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260928 07:56:02.432971 28667 ts_tablet_manager.cc:1434] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260928 07:56:02.433885 28667 tablet_bootstrap.cc:492] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:02.443811 28185 tablet_service.cc:1511] Processing CreateTablet for tablet f21e8b5dc66f42109f6484aa6908c9be (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.445204 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21e8b5dc66f42109f6484aa6908c9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:02.450263 28666 tablet_bootstrap.cc:492] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:02.450712 28666 ts_tablet_manager.cc:1403] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.064s user 0.011s sys 0.000s
I20260928 07:56:02.451750 28667 tablet_bootstrap.cc:654] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.459653 28331 tablet_service.cc:1511] Processing CreateTablet for tablet f21e8b5dc66f42109f6484aa6908c9be (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.453393 28666 raft_consensus.cc:359] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.460974 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21e8b5dc66f42109f6484aa6908c9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:02.469302 28732 raft_consensus.cc:493] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:02.469837 28732 raft_consensus.cc:515] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.472016 28732 leader_election.cc:290] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.472802 28667 tablet_bootstrap.cc:492] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:02.473263 28667 ts_tablet_manager.cc:1403] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.000s
I20260928 07:56:02.473666 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97a4439c50f4c8e98baef9e98bb31d6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:02.475489 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97a4439c50f4c8e98baef9e98bb31d6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:02.475687 28142 leader_election.cc:343] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:02.476181 28499 raft_consensus.cc:2468] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:02.476279 28667 raft_consensus.cc:359] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.476938 28667 raft_consensus.cc:385] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.477732 28141 leader_election.cc:304] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:02.479061 28732 raft_consensus.cc:2804] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:02.479557 28732 raft_consensus.cc:493] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:02.480091 28732 raft_consensus.cc:3060] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:02.487922 28732 raft_consensus.cc:515] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.477203 28667 raft_consensus.cc:740] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.492343 28479 tablet_service.cc:1511] Processing CreateTablet for tablet f21e8b5dc66f42109f6484aa6908c9be (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.493834 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21e8b5dc66f42109f6484aa6908c9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:02.460565 28666 raft_consensus.cc:385] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.497570 28666 raft_consensus.cc:740] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
W20260928 07:56:02.500332 28733 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54230: Illegal state: RaftConsensus is not running: State = Stopped
I20260928 07:56:02.500814 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 8e97445037aa466cb76e1e24d76ee6dd deleted and replaced by tablet f21e8b5dc66f42109f6484aa6908c9be
I20260928 07:56:02.500818 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97a4439c50f4c8e98baef9e98bb31d6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:02.493194 28667 consensus_queue.cc:260] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.503026 28351 raft_consensus.cc:3060] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:02.504092 28667 ts_tablet_manager.cc:1434] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.031s user 0.000s sys 0.006s
I20260928 07:56:02.504931 28667 tablet_bootstrap.cc:492] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:02.510675 28667 tablet_bootstrap.cc:654] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.510998 28351 raft_consensus.cc:2468] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
W20260928 07:56:02.522603 27815 catalog_manager.cc:5142] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): alter failed for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]): Illegal state: RaftConsensus is not running: State = Stopped
I20260928 07:56:02.524048 28142 leader_election.cc:304] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:02.524966 28664 raft_consensus.cc:2804] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:02.529372 28664 raft_consensus.cc:697] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:02.530598 28664 consensus_queue.cc:237] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.532991 28667 tablet_bootstrap.cc:492] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:02.533492 28667 ts_tablet_manager.cc:1403] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.010s
I20260928 07:56:02.536825 28667 raft_consensus.cc:359] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.538343 28667 raft_consensus.cc:385] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.538669 28667 raft_consensus.cc:740] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.539692 28667 consensus_queue.cc:260] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.547960 28667 ts_tablet_manager.cc:1434] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.014s user 0.003s sys 0.004s
I20260928 07:56:02.549896 28656 ts_tablet_manager.cc:1916] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:02.552474 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet c4ccdaf195e64ddf88818da6b73a5aac from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:02.554051 28666 consensus_queue.cc:260] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.558758 28666 ts_tablet_manager.cc:1434] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.108s user 0.007s sys 0.000s
I20260928 07:56:02.561056 28662 tablet_bootstrap.cc:492] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:02.565122 28732 leader_election.cc:290] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.566977 28662 tablet_bootstrap.cc:654] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.568432 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97a4439c50f4c8e98baef9e98bb31d6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:02.593012 28499 raft_consensus.cc:3060] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:02.607287 28658 ts_tablet_manager.cc:1929] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:02.607728 28658 log.cc:1199] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/2f56b9e5701f41969d3edfa87fb95b13
I20260928 07:56:02.610996 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet c4ccdaf195e64ddf88818da6b73a5aac
I20260928 07:56:02.611398 28658 ts_tablet_manager.cc:1950] T 2f56b9e5701f41969d3edfa87fb95b13 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:02.613660 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet c4ccdaf195e64ddf88818da6b73a5aac with delete_type TABLET_DATA_DELETED (replaced by tablet c8213c2eadae427190bfc621d40ae1f6) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:02.613894 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet c4ccdaf195e64ddf88818da6b73a5aac with delete_type TABLET_DATA_DELETED (replaced by tablet c8213c2eadae427190bfc621d40ae1f6) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:02.614450 27822 catalog_manager.cc:6934] ReplaceTablet: tablet c4ccdaf195e64ddf88818da6b73a5aac deleted and replaced by tablet c8213c2eadae427190bfc621d40ae1f6
I20260928 07:56:02.617048 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet c4ccdaf195e64ddf88818da6b73a5aac with delete_type TABLET_DATA_DELETED (replaced by tablet c8213c2eadae427190bfc621d40ae1f6) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:02.645879 28667 tablet_bootstrap.cc:492] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:02.646453 28185 tablet_service.cc:1511] Processing CreateTablet for tablet c8213c2eadae427190bfc621d40ae1f6 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.647687 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8213c2eadae427190bfc621d40ae1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:02.655684 28667 tablet_bootstrap.cc:654] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.656126 28499 raft_consensus.cc:2468] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:02.666079 28331 tablet_service.cc:1511] Processing CreateTablet for tablet c8213c2eadae427190bfc621d40ae1f6 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.667166 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8213c2eadae427190bfc621d40ae1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:02.496595 28657 ts_tablet_manager.cc:1929] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:02.668035 28657 log.cc:1199] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/2f56b9e5701f41969d3edfa87fb95b13
I20260928 07:56:02.660519 28666 tablet_bootstrap.cc:492] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:02.670068 28657 ts_tablet_manager.cc:1950] T 2f56b9e5701f41969d3edfa87fb95b13 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:02.675036 28479 tablet_service.cc:1511] Processing CreateTablet for tablet c8213c2eadae427190bfc621d40ae1f6 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:02.677467 28705 raft_consensus.cc:493] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:02.678107 28705 raft_consensus.cc:515] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.680401 28705 leader_election.cc:290] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.684284 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8213c2eadae427190bfc621d40ae1f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:02.689766 28286 leader_election.cc:343] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 2188651a70264d7f876713e184a5bedb
I20260928 07:56:02.694573 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 23) took 1234 ms. Trace:
I20260928 07:56:02.694936 28658 rpcz_store.cc:276] 0928 07:56:01.460020 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:01.460159 (+ 139us) service_pool.cc:224] Handling call
0928 07:56:02.122591 (+662432us) ts_tablet_manager.cc:1151] Deleting tablet 2f56b9e5701f41969d3edfa87fb95b13
0928 07:56:02.122629 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:02.315561 (+192932us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:02.589593 (+274032us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:02.694498 (+104905us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":661811}
I20260928 07:56:02.696416 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 2f56b9e5701f41969d3edfa87fb95b13 (table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:02.697420 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188651a70264d7f876713e184a5bedb" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:02.698125 28499 raft_consensus.cc:2468] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:02.699268 28285 leader_election.cc:304] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:02.700542 28705 raft_consensus.cc:2804] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:02.700948 28705 raft_consensus.cc:493] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:02.701297 28705 raft_consensus.cc:3060] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:02.706099 27816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260928 07:56:02.710438 28705 raft_consensus.cc:515] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:02.714210 28286 leader_election.cc:343] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 2188651a70264d7f876713e184a5bedb
I20260928 07:56:02.717821 28658 tablet_replica.cc:333] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:02.718632 28658 raft_consensus.cc:2243] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:02.723290 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet c4ccdaf195e64ddf88818da6b73a5aac from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:02.726150 28705 leader_election.cc:290] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
W20260928 07:56:02.727125 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260928 07:56:02.730681 28657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 24) took 1260 ms. Trace:
I20260928 07:56:02.731174 28657 rpcz_store.cc:276] 0928 07:56:01.456958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:01.457118 (+ 160us) service_pool.cc:224] Handling call
0928 07:56:02.106409 (+649291us) ts_tablet_manager.cc:1151] Deleting tablet 2f56b9e5701f41969d3edfa87fb95b13
0928 07:56:02.106457 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:02.361923 (+255466us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:02.496460 (+134537us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:02.717214 (+220754us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":648574}
I20260928 07:56:02.733101 28657 tablet_replica.cc:333] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:02.733920 28657 raft_consensus.cc:2243] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:02.734455 28657 raft_consensus.cc:2272] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.735038 28658 raft_consensus.cc:2272] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.736924 28658 ts_tablet_manager.cc:1916] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:02.721262 28666 tablet_bootstrap.cc:654] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.727988 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188651a70264d7f876713e184a5bedb" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:02.745566 28499 raft_consensus.cc:3060] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:02.762212 28662 tablet_bootstrap.cc:492] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:02.762696 28662 ts_tablet_manager.cc:1403] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.202s user 0.035s sys 0.055s
I20260928 07:56:02.763111 28656 ts_tablet_manager.cc:1929] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:02.763532 28656 log.cc:1199] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/8e97445037aa466cb76e1e24d76ee6dd
I20260928 07:56:02.764315 28656 ts_tablet_manager.cc:1950] T 8e97445037aa466cb76e1e24d76ee6dd P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:02.744184 28667 tablet_bootstrap.cc:492] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:02.765760 28667 ts_tablet_manager.cc:1403] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.120s user 0.008s sys 0.008s
I20260928 07:56:02.768502 28667 raft_consensus.cc:359] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.769212 28667 raft_consensus.cc:385] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.769563 28667 raft_consensus.cc:740] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.770268 28667 consensus_queue.cc:260] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.772176 28667 ts_tablet_manager.cc:1434] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260928 07:56:02.774786 28657 ts_tablet_manager.cc:1916] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:02.777644 28662 raft_consensus.cc:359] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.778345 28662 raft_consensus.cc:385] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.778616 28662 raft_consensus.cc:740] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.773093 28667 tablet_bootstrap.cc:492] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:02.779376 28662 consensus_queue.cc:260] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.781594 28662 ts_tablet_manager.cc:1434] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260928 07:56:02.793592 28666 tablet_bootstrap.cc:492] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:02.794122 28666 ts_tablet_manager.cc:1403] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.202s user 0.011s sys 0.000s
I20260928 07:56:02.798501 28662 tablet_bootstrap.cc:492] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:02.806551 28662 tablet_bootstrap.cc:654] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.803265 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 2f56b9e5701f41969d3edfa87fb95b13 (table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:02.806644 28499 raft_consensus.cc:2468] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:02.814008 28656 tablet_replica.cc:333] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:02.796685 28666 raft_consensus.cc:359] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.814484 28666 raft_consensus.cc:385] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.814807 28666 raft_consensus.cc:740] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.814597 28285 leader_election.cc:304] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:02.815828 28705 raft_consensus.cc:2804] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:02.818145 28656 raft_consensus.cc:2243] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:02.818816 28656 pending_rounds.cc:70] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:02.819038 28656 pending_rounds.cc:77] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224537256001536 op_type: NO_OP noop_request { }
I20260928 07:56:02.819391 28656 raft_consensus.cc:2889] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:02.819736 28656 raft_consensus.cc:2272] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.820499 28666 consensus_queue.cc:260] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.819952 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:02.806208 27822 catalog_manager.cc:5838] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:02.812351 27821 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
W20260928 07:56:02.828088 27821 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f21e8b5dc66f42109f6484aa6908c9be consensus state has no leader
I20260928 07:56:02.830572 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet c4ccdaf195e64ddf88818da6b73a5aac from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:02.834947 27821 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:02.835554 28666 ts_tablet_manager.cc:1434] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260928 07:56:02.846417 28705 raft_consensus.cc:697] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:02.854130 28666 tablet_bootstrap.cc:492] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:02.847978 28749 raft_consensus.cc:493] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:02.856819 28662 tablet_bootstrap.cc:492] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:02.857288 28662 ts_tablet_manager.cc:1403] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.059s user 0.013s sys 0.001s
I20260928 07:56:02.849028 28705 consensus_queue.cc:237] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.854830 28749 raft_consensus.cc:515] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.860180 28662 raft_consensus.cc:359] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.860800 28662 raft_consensus.cc:385] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.861064 28662 raft_consensus.cc:740] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.861785 28662 consensus_queue.cc:260] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:02.866406 28286 leader_election.cc:343] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 8e97445037aa466cb76e1e24d76ee6dd
I20260928 07:56:02.865429 27821 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:02.868279 28662 ts_tablet_manager.cc:1434] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260928 07:56:02.868018 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e97445037aa466cb76e1e24d76ee6dd" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:02.869625 28499 raft_consensus.cc:2393] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bd67de620c94af3b7c8e3ba7d42f980 in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:02.870858 28285 leader_election.cc:304] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:02.873102 28748 raft_consensus.cc:3060] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:02.879153 28749 leader_election.cc:290] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.885655 27821 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:02.888505 28667 tablet_bootstrap.cc:654] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.893169 28656 ts_tablet_manager.cc:1916] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:02.893492 28732 raft_consensus.cc:493] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:02.893960 28732 raft_consensus.cc:515] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.895006 28658 ts_tablet_manager.cc:1929] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:02.895375 28658 log.cc:1199] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/2f9c27f01a83497585e1198c108d8254
I20260928 07:56:02.896024 28658 ts_tablet_manager.cc:1950] T 2f9c27f01a83497585e1198c108d8254 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:02.896051 28732 leader_election.cc:290] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:02.899717 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8213c2eadae427190bfc621d40ae1f6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:02.899741 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8213c2eadae427190bfc621d40ae1f6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:02.900044 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
W20260928 07:56:02.901129 28141 leader_election.cc:343] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:02.901640 28142 leader_election.cc:343] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:02.902030 28142 leader_election.cc:304] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:02.903129 28732 raft_consensus.cc:2749] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:02.907518 28748 raft_consensus.cc:2749] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 07:56:02.913472 28089 hms_client.cc:355] Time spent drop HMS table: real 2.652s user 0.000s sys 0.000s
I20260928 07:56:02.914896 27827 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]
I20260928 07:56:02.897903 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 25) took 1195 ms. Trace:
I20260928 07:56:02.917212 28658 rpcz_store.cc:276] 0928 07:56:01.702072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:01.702240 (+ 168us) service_pool.cc:224] Handling call
0928 07:56:02.717642 (+1015402us) ts_tablet_manager.cc:1151] Deleting tablet 2f9c27f01a83497585e1198c108d8254
0928 07:56:02.717703 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:02.858593 (+140890us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:02.894879 (+ 36286us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:02.897844 (+ 2965us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1014760}
I20260928 07:56:02.918769 28658 tablet_replica.cc:333] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:02.919564 28658 raft_consensus.cc:2243] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:02.920048 28658 raft_consensus.cc:2272] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.921774 28658 ts_tablet_manager.cc:1916] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:02.928117 27814 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f21e8b5dc66f42109f6484aa6908c9be consensus state has no leader
I20260928 07:56:02.928889 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 2f9c27f01a83497585e1198c108d8254 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:02.932904 28666 tablet_bootstrap.cc:654] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:02.933373 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet f21e8b5dc66f42109f6484aa6908c9be from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:02.940258 28657 ts_tablet_manager.cc:1929] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:02.940649 28657 log.cc:1199] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/2f9c27f01a83497585e1198c108d8254
I20260928 07:56:02.941320 28657 ts_tablet_manager.cc:1950] T 2f9c27f01a83497585e1198c108d8254 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:02.958799 28657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 26) took 1256 ms. Trace:
I20260928 07:56:02.959200 28657 rpcz_store.cc:276] 0928 07:56:01.702671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:01.702908 (+ 237us) service_pool.cc:224] Handling call
0928 07:56:02.732946 (+1030038us) ts_tablet_manager.cc:1151] Deleting tablet 2f9c27f01a83497585e1198c108d8254
0928 07:56:02.732991 (+ 45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:02.887780 (+154789us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:02.940111 (+ 52331us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:02.958729 (+ 18618us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029470}
I20260928 07:56:02.960692 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 2f9c27f01a83497585e1198c108d8254 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:02.960846 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet f21e8b5dc66f42109f6484aa6908c9be
I20260928 07:56:02.961984 28657 tablet_replica.cc:333] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:02.962971 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet f21e8b5dc66f42109f6484aa6908c9be with delete_type TABLET_DATA_DELETED (replaced by tablet 534a8d19fbe0460e98e4e61b3de13d6a) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:02.963392 28666 tablet_bootstrap.cc:492] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:02.963835 28666 ts_tablet_manager.cc:1403] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.110s user 0.009s sys 0.000s
I20260928 07:56:02.964591 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet f21e8b5dc66f42109f6484aa6908c9be with delete_type TABLET_DATA_DELETED (replaced by tablet 534a8d19fbe0460e98e4e61b3de13d6a) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:02.965955 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet f21e8b5dc66f42109f6484aa6908c9be with delete_type TABLET_DATA_DELETED (replaced by tablet 534a8d19fbe0460e98e4e61b3de13d6a) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:02.966529 28666 raft_consensus.cc:359] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.967191 28666 raft_consensus.cc:385] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:02.967473 28666 raft_consensus.cc:740] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:02.967605 28657 raft_consensus.cc:2243] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:02.972199 27821 catalog_manager.cc:6934] ReplaceTablet: tablet f21e8b5dc66f42109f6484aa6908c9be deleted and replaced by tablet 534a8d19fbe0460e98e4e61b3de13d6a
I20260928 07:56:02.972788 28657 raft_consensus.cc:2272] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:02.973850 28666 consensus_queue.cc:260] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:02.974196 28656 ts_tablet_manager.cc:1929] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:02.984309 28666 ts_tablet_manager.cc:1434] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.020s user 0.008s sys 0.000s
I20260928 07:56:03.007014 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 534a8d19fbe0460e98e4e61b3de13d6a (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.010376 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534a8d19fbe0460e98e4e61b3de13d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.012425 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 534a8d19fbe0460e98e4e61b3de13d6a (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.013511 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534a8d19fbe0460e98e4e61b3de13d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.021924 28656 log.cc:1199] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/c4ccdaf195e64ddf88818da6b73a5aac
I20260928 07:56:03.023619 28667 tablet_bootstrap.cc:492] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:03.024461 28656 ts_tablet_manager.cc:1950] T c4ccdaf195e64ddf88818da6b73a5aac P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:03.039214 28656 tablet_replica.cc:333] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:03.039064 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 534a8d19fbe0460e98e4e61b3de13d6a (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.039938 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet c4ccdaf195e64ddf88818da6b73a5aac (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:03.040297 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534a8d19fbe0460e98e4e61b3de13d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.009001 28657 ts_tablet_manager.cc:1916] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.043758 28667 ts_tablet_manager.cc:1403] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.271s user 0.002s sys 0.010s
I20260928 07:56:03.045847 28667 raft_consensus.cc:359] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.046476 28667 raft_consensus.cc:385] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.046727 28667 raft_consensus.cc:740] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.047452 28667 consensus_queue.cc:260] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.057324 28748 raft_consensus.cc:493] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:03.057822 28748 raft_consensus.cc:515] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.059883 28748 leader_election.cc:290] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:03.060628 27825 catalog_manager.cc:2213] created HMS catalog entry for table [id=8050a64da16d4203b539e643bf5c92a9]
I20260928 07:56:03.066020 28667 ts_tablet_manager.cc:1434] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.022s user 0.004s sys 0.001s
W20260928 07:56:03.073872 28286 leader_election.cc:343] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 002fa916faa3453798288b9d53857b57
I20260928 07:56:03.075855 28667 tablet_bootstrap.cc:492] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:03.081084 27825 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 7) took 4605 ms. Trace:
W20260928 07:56:03.083355 27815 catalog_manager.cc:5136] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): alter failed for tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]),no further retry: Not found: Tablet not found: 8e97445037aa466cb76e1e24d76ee6dd
I20260928 07:56:03.081543 27825 rpcz_store.cc:276] 0928 07:55:58.475242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:58.475399 (+ 157us) service_pool.cc:224] Handling call
0928 07:55:59.860594 (+1385195us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:55:59.869340 (+ 8746us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:03.060456 (+3191116us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:03.080126 (+ 19670us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:03.080464 (+ 338us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:03.080965 (+ 501us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:03.062757 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:03.063301 (+ 544us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:03.063328 (+ 27us) write_op.cc:435] Acquired schema lock
0928 07:56:03.063342 (+ 14us) tablet.cc:662] Decoding operations
0928 07:56:03.063652 (+ 310us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:03.063702 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:03.063729 (+ 27us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:03.063975 (+ 246us) tablet.cc:701] Row locks acquired
0928 07:56:03.063993 (+ 18us) write_op.cc:260] PREPARE: finished
0928 07:56:03.064128 (+ 135us) write_op.cc:270] Start()
0928 07:56:03.064225 (+ 97us) write_op.cc:276] Timestamp: P: 1790582163064012 usec, L: 0
0928 07:56:03.064238 (+ 13us) op_driver.cc:348] REPLICATION: starting
0928 07:56:03.064803 (+ 565us) log.cc:844] Serialized 432 byte log entry
0928 07:56:03.077295 (+ 12492us) op_driver.cc:464] REPLICATION: finished
0928 07:56:03.078481 (+ 1186us) write_op.cc:301] APPLY: starting
0928 07:56:03.078547 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:03.078670 (+ 123us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:03.078804 (+ 134us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:03.079252 (+ 448us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:03.079390 (+ 138us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:03.079432 (+ 42us) write_op.cc:312] APPLY: finished
0928 07:56:03.079633 (+ 201us) log.cc:844] Serialized 28 byte log entry
0928 07:56:03.079806 (+ 173us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:03.079879 (+ 73us) write_op.cc:454] Released schema lock
0928 07:56:03.079918 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:03.080147 (+ 229us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:03.080173 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":3044003,"Hive Metastore.run_cpu_time_us":737,"Hive Metastore.run_wall_time_us":146139,"child_traces":[["op",{"apply.queue_time_us":1002,"apply.run_cpu_time_us":1654,"apply.run_wall_time_us":1651,"num_ops":2,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":2405,"prepare.run_wall_time_us":2409,"raft.queue_time_us":2746,"raft.run_cpu_time_us":774,"raft.run_wall_time_us":776,"replication_time_us":12926}]]}
I20260928 07:56:03.088650 28667 tablet_bootstrap.cc:654] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.099782 28667 tablet_bootstrap.cc:492] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:03.100330 28667 ts_tablet_manager.cc:1403] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.007s
I20260928 07:56:03.103085 28667 raft_consensus.cc:359] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.103943 28667 raft_consensus.cc:385] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.104261 28667 raft_consensus.cc:740] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.105070 28667 consensus_queue.cc:260] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.109438 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.115368 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e48d66a1f934fb2aa6772d0ffcb0960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.115654 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.116606 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e48d66a1f934fb2aa6772d0ffcb0960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.133512 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet c8213c2eadae427190bfc621d40ae1f6 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:03.114281 28667 ts_tablet_manager.cc:1434] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260928 07:56:03.136819 28667 tablet_bootstrap.cc:492] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:03.141093 28656 raft_consensus.cc:2243] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.141610 28656 raft_consensus.cc:2272] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.050997 28658 ts_tablet_manager.cc:1929] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.064056 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002fa916faa3453798288b9d53857b57" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:03.125555 28666 tablet_bootstrap.cc:492] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:03.132874 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.146432 28658 log.cc:1199] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/002fa916faa3453798288b9d53857b57
W20260928 07:56:03.146920 28285 leader_election.cc:343] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: Tablet not RUNNING: STOPPED
I20260928 07:56:03.147166 28658 ts_tablet_manager.cc:1950] T 002fa916faa3453798288b9d53857b57 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:03.147231 28662 tablet_bootstrap.cc:492] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:03.147374 28285 leader_election.cc:304] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:03.148548 28748 raft_consensus.cc:2749] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:03.152972 28656 ts_tablet_manager.cc:1916] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.146449 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e48d66a1f934fb2aa6772d0ffcb0960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.159442 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 27) took 1321 ms. Trace:
I20260928 07:56:03.159793 28658 rpcz_store.cc:276] 0928 07:56:01.837629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:01.838298 (+ 669us) service_pool.cc:224] Handling call
0928 07:56:02.918605 (+1080307us) ts_tablet_manager.cc:1151] Deleting tablet 002fa916faa3453798288b9d53857b57
0928 07:56:02.918652 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:02.967293 (+ 48641us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.050831 (+ 83538us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.159377 (+108546us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079716}
I20260928 07:56:03.160890 28658 tablet_replica.cc:333] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:03.161520 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 002fa916faa3453798288b9d53857b57 (table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:03.163748 28666 tablet_bootstrap.cc:654] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.165253 28662 tablet_bootstrap.cc:654] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.168814 28667 tablet_bootstrap.cc:654] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.170431 28658 raft_consensus.cc:2243] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.176921 28666 tablet_bootstrap.cc:492] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:03.177426 28666 ts_tablet_manager.cc:1403] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.052s user 0.010s sys 0.000s
I20260928 07:56:03.184047 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet d97a4439c50f4c8e98baef9e98bb31d6 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:03.185938 28667 tablet_bootstrap.cc:492] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:03.186370 28667 ts_tablet_manager.cc:1403] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.004s
I20260928 07:56:03.188807 28667 raft_consensus.cc:359] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.168322 28656 ts_tablet_manager.cc:1929] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.189531 28667 raft_consensus.cc:385] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.189810 28667 raft_consensus.cc:740] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.190104 28656 log.cc:1199] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/f21e8b5dc66f42109f6484aa6908c9be
I20260928 07:56:03.190445 28667 consensus_queue.cc:260] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.191627 28656 ts_tablet_manager.cc:1950] T f21e8b5dc66f42109f6484aa6908c9be P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:03.192582 28658 raft_consensus.cc:2272] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.194378 28658 ts_tablet_manager.cc:1916] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.194545 28666 raft_consensus.cc:359] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.195120 28666 raft_consensus.cc:385] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.195392 28666 raft_consensus.cc:740] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.196054 28666 consensus_queue.cc:260] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.196578 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:03.197944 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet c8213c2eadae427190bfc621d40ae1f6
I20260928 07:56:03.199940 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet c8213c2eadae427190bfc621d40ae1f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 2adff7db0fe54fc2bceb57fbc1f2fd72) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:03.201552 28657 ts_tablet_manager.cc:1929] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.201956 28657 log.cc:1199] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/8508bef44eb54c73b716d7a0472e0803
I20260928 07:56:03.202654 28657 ts_tablet_manager.cc:1950] T 8508bef44eb54c73b716d7a0472e0803 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:03.203096 28656 tablet_replica.cc:333] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:03.203220 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet c8213c2eadae427190bfc621d40ae1f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 2adff7db0fe54fc2bceb57fbc1f2fd72) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:03.203816 28656 raft_consensus.cc:2243] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.209408 28657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 28) took 1384 ms. Trace:
I20260928 07:56:03.204269 28656 raft_consensus.cc:2272] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.211479 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet d97a4439c50f4c8e98baef9e98bb31d6
I20260928 07:56:03.212958 27821 catalog_manager.cc:6934] ReplaceTablet: tablet d97a4439c50f4c8e98baef9e98bb31d6 deleted and replaced by tablet 850394ead0474f0d8f89d039fa586a2d
I20260928 07:56:03.213374 28666 ts_tablet_manager.cc:1434] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.036s user 0.006s sys 0.000s
I20260928 07:56:03.214018 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet d97a4439c50f4c8e98baef9e98bb31d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 850394ead0474f0d8f89d039fa586a2d) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:03.215109 28662 tablet_bootstrap.cc:492] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:03.215525 28662 ts_tablet_manager.cc:1403] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.068s user 0.008s sys 0.000s
I20260928 07:56:03.216521 28677 raft_consensus.cc:493] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:03.216960 28677 raft_consensus.cc:515] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.218915 28677 leader_election.cc:290] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:03.220858 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet d97a4439c50f4c8e98baef9e98bb31d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 850394ead0474f0d8f89d039fa586a2d) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:03.220883 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:03.225147 28666 tablet_bootstrap.cc:492] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:03.226152 28656 ts_tablet_manager.cc:1916] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.227933 27822 catalog_manager.cc:6934] ReplaceTablet: tablet c8213c2eadae427190bfc621d40ae1f6 deleted and replaced by tablet 2adff7db0fe54fc2bceb57fbc1f2fd72
W20260928 07:56:03.236909 28434 leader_election.cc:343] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:03.237859 28677 raft_consensus.cc:493] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:03.238402 28677 raft_consensus.cc:515] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.241037 28662 raft_consensus.cc:359] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.245602 28658 ts_tablet_manager.cc:1929] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.246006 28658 log.cc:1199] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/2188651a70264d7f876713e184a5bedb
I20260928 07:56:03.246675 28658 ts_tablet_manager.cc:1950] T 2188651a70264d7f876713e184a5bedb P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:03.246732 28677 leader_election.cc:290] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:03.248931 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 29) took 1130 ms. Trace:
I20260928 07:56:03.249317 28658 rpcz_store.cc:276] 0928 07:56:02.118797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:02.118946 (+ 149us) service_pool.cc:224] Handling call
0928 07:56:03.160730 (+1041784us) ts_tablet_manager.cc:1151] Deleting tablet 2188651a70264d7f876713e184a5bedb
0928 07:56:03.160770 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:03.226636 (+ 65866us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.245468 (+ 18832us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.248862 (+ 3394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1041187}
I20260928 07:56:03.255964 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 2188651a70264d7f876713e184a5bedb (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:03.257055 28658 tablet_replica.cc:333] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:03.257879 28658 raft_consensus.cc:2243] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.258477 28658 raft_consensus.cc:2272] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.260207 28658 ts_tablet_manager.cc:1916] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.245186 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e295d50f83468184bb8edd29738907" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:03.260812 28206 raft_consensus.cc:2468] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:03.262032 28434 leader_election.cc:304] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:03.263151 28677 raft_consensus.cc:2804] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:03.263266 28656 ts_tablet_manager.cc:1929] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.263652 28656 log.cc:1199] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/c8213c2eadae427190bfc621d40ae1f6
I20260928 07:56:03.263612 28677 raft_consensus.cc:493] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:03.264087 28677 raft_consensus.cc:3060] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:03.264345 28656 ts_tablet_manager.cc:1950] T c8213c2eadae427190bfc621d40ae1f6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:03.266563 27825 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:03.268468 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 07:56:03.268601 27825 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 534a8d19fbe0460e98e4e61b3de13d6a consensus state has no leader
I20260928 07:56:03.269670 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.275238 27822 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:03.282303 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.283116 28662 raft_consensus.cc:385] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.283424 28662 raft_consensus.cc:740] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.283548 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.285472 28662 consensus_queue.cc:260] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.288004 28666 tablet_bootstrap.cc:654] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.291118 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet d97a4439c50f4c8e98baef9e98bb31d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 850394ead0474f0d8f89d039fa586a2d) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:03.291069 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e295d50f83468184bb8edd29738907" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:03.292366 28350 raft_consensus.cc:2468] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:03.293531 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 (DEFAULT_TABLE table=default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.295106 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.297633 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet c8213c2eadae427190bfc621d40ae1f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 2adff7db0fe54fc2bceb57fbc1f2fd72) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:03.296872 27825 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_182658f932d9407599c8db9fcee8c679"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:03.297557 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet c8213c2eadae427190bfc621d40ae1f6 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:03.297852 28656 tablet_replica.cc:333] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:03.298728 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:03.299782 28351 raft_consensus.cc:2468] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:03.298534 28656 raft_consensus.cc:2243] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:03.301398 28656 pending_rounds.cc:70] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:03.301663 28656 pending_rounds.cc:77] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224537736183808 op_type: NO_OP noop_request { }
I20260928 07:56:03.302021 28656 raft_consensus.cc:2889] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:03.302399 28656 raft_consensus.cc:2272] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.209744 28657 rpcz_store.cc:276] 0928 07:56:01.824930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:01.825122 (+ 192us) service_pool.cc:224] Handling call
0928 07:56:02.961815 (+1136693us) ts_tablet_manager.cc:1151] Deleting tablet 8508bef44eb54c73b716d7a0472e0803
0928 07:56:02.961863 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:03.127276 (+165413us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.201424 (+ 74148us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.209338 (+ 7914us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1135957}
I20260928 07:56:03.312510 28657 tablet_replica.cc:333] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:03.313958 28657 raft_consensus.cc:2243] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.314138 28656 ts_tablet_manager.cc:1916] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.314486 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 8508bef44eb54c73b716d7a0472e0803 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:03.314647 28657 raft_consensus.cc:2272] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.318027 28657 ts_tablet_manager.cc:1916] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.327134 28662 ts_tablet_manager.cc:1434] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.111s user 0.007s sys 0.000s
I20260928 07:56:03.325088 28667 ts_tablet_manager.cc:1434] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.138s user 0.008s sys 0.000s
I20260928 07:56:03.331736 28667 tablet_bootstrap.cc:492] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:03.339031 28762 raft_consensus.cc:493] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:03.339530 28762 raft_consensus.cc:515] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.343441 28434 leader_election.cc:304] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:03.344444 28662 tablet_bootstrap.cc:492] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:03.345656 28677 raft_consensus.cc:515] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.347615 28677 leader_election.cc:290] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:03.348150 28677 raft_consensus.cc:2804] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:03.348452 28677 raft_consensus.cc:493] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:03.348807 28677 raft_consensus.cc:3060] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:03.348985 28658 ts_tablet_manager.cc:1929] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.352677 28656 ts_tablet_manager.cc:1929] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:03.353026 28656 log.cc:1199] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/d97a4439c50f4c8e98baef9e98bb31d6
I20260928 07:56:03.353161 28658 log.cc:1199] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/8e97445037aa466cb76e1e24d76ee6dd
I20260928 07:56:03.355221 28658 ts_tablet_manager.cc:1950] T 8e97445037aa466cb76e1e24d76ee6dd P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:03.364215 28662 tablet_bootstrap.cc:654] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.365020 28658 tablet_replica.cc:333] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:03.365835 28658 raft_consensus.cc:2243] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.366446 28658 raft_consensus.cc:2272] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.369065 28732 raft_consensus.cc:493] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:03.369570 28732 raft_consensus.cc:515] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.371685 28732 leader_election.cc:290] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:03.371917 27821 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:03.374527 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:03.375129 28351 raft_consensus.cc:2468] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:03.376332 28142 leader_election.cc:304] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:03.376722 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 850394ead0474f0d8f89d039fa586a2d (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.377840 28656 ts_tablet_manager.cc:1950] T d97a4439c50f4c8e98baef9e98bb31d6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:03.377854 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 850394ead0474f0d8f89d039fa586a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.381654 27821 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:03.384392 28732 raft_consensus.cc:2804] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:03.384747 28732 raft_consensus.cc:493] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:03.385068 28732 raft_consensus.cc:3060] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:03.387275 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet d97a4439c50f4c8e98baef9e98bb31d6 (table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:03.389952 27822 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:03.390444 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 850394ead0474f0d8f89d039fa586a2d (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.391567 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 850394ead0474f0d8f89d039fa586a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.397987 27821 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:03.404419 28732 raft_consensus.cc:515] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.410672 28658 ts_tablet_manager.cc:1916] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.412653 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:03.413295 28351 raft_consensus.cc:3060] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:03.413502 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:03.419862 28351 raft_consensus.cc:2468] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:03.421092 28142 leader_election.cc:304] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:03.422070 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 850394ead0474f0d8f89d039fa586a2d (DEFAULT_TABLE table=default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.423049 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 850394ead0474f0d8f89d039fa586a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.424618 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet 3e48d66a1f934fb2aa6772d0ffcb0960 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:03.430938 28765 raft_consensus.cc:2804] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 07:56:03.409001 28655 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 07:56:03.436995 28655 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 07:56:03.439945 28655 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 07:56:03.448381 28434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 105103us
I20260928 07:56:03.449111 28762 leader_election.cc:290] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:03.450176 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e295d50f83468184bb8edd29738907" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:03.450753 28206 raft_consensus.cc:3060] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:03.456626 28658 ts_tablet_manager.cc:1929] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.457587 28206 raft_consensus.cc:2468] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:03.460814 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21e8b5dc66f42109f6484aa6908c9be" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:03.461463 28350 raft_consensus.cc:2468] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:03.463434 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:03.464128 28434 leader_election.cc:343] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: f21e8b5dc66f42109f6484aa6908c9be
I20260928 07:56:03.464730 28658 log.cc:1199] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/c4ccdaf195e64ddf88818da6b73a5aac
I20260928 07:56:03.465062 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e295d50f83468184bb8edd29738907" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:03.465751 28351 raft_consensus.cc:3060] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:03.464128 28677 raft_consensus.cc:515] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.468420 28499 raft_consensus.cc:2393] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate acdaa3cf2ffd45f5b55a169c1bacead5 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:03.470762 28666 tablet_bootstrap.cc:492] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:03.465799 28658 ts_tablet_manager.cc:1950] T c4ccdaf195e64ddf88818da6b73a5aac P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:03.472102 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 3e48d66a1f934fb2aa6772d0ffcb0960
I20260928 07:56:03.473639 28677 leader_election.cc:290] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:03.474015 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 with delete_type TABLET_DATA_DELETED (replaced by tablet ca01956e0d5141438038dc3f9110cc64) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:03.474911 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 with delete_type TABLET_DATA_DELETED (replaced by tablet ca01956e0d5141438038dc3f9110cc64) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:03.475237 27821 catalog_manager.cc:6934] ReplaceTablet: tablet 3e48d66a1f934fb2aa6772d0ffcb0960 deleted and replaced by tablet ca01956e0d5141438038dc3f9110cc64
I20260928 07:56:03.477056 28732 leader_election.cc:290] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
W20260928 07:56:03.477077 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e48d66a1f934fb2aa6772d0ffcb0960 already in progress: creating tablet
I20260928 07:56:03.476248 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 with delete_type TABLET_DATA_DELETED (replaced by tablet ca01956e0d5141438038dc3f9110cc64) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:03.478406 28658 tablet_replica.cc:333] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:03.478600 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet c4ccdaf195e64ddf88818da6b73a5aac (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:03.479089 28434 leader_election.cc:304] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:03.479882 28658 raft_consensus.cc:2243] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.485101 28658 raft_consensus.cc:2272] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.486920 28658 ts_tablet_manager.cc:1916] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.487756 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:03.480309 28677 raft_consensus.cc:2804] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:03.488802 28677 raft_consensus.cc:697] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:03.489681 28677 consensus_queue.cc:237] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.508782 28330 tablet_service.cc:1511] Processing CreateTablet for tablet ca01956e0d5141438038dc3f9110cc64 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.510078 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca01956e0d5141438038dc3f9110cc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.509879 28765 raft_consensus.cc:697] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:03.510959 28765 consensus_queue.cc:237] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.471154 28666 ts_tablet_manager.cc:1403] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.246s user 0.013s sys 0.000s
I20260928 07:56:03.515741 28477 tablet_service.cc:1511] Processing CreateTablet for tablet ca01956e0d5141438038dc3f9110cc64 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.515861 28666 raft_consensus.cc:359] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.521813 28186 tablet_service.cc:1511] Processing CreateTablet for tablet ca01956e0d5141438038dc3f9110cc64 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.523051 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca01956e0d5141438038dc3f9110cc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.527246 27824 catalog_manager.cc:2213] created HMS catalog entry for table [id=f5cc5d847243471fb78c00c7ff2bdbe9]
I20260928 07:56:03.531047 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:03.531976 28350 raft_consensus.cc:2393] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:03.536968 28667 tablet_bootstrap.cc:654] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.517328 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca01956e0d5141438038dc3f9110cc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.549749 27824 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 9) took 4940 ms. Trace:
I20260928 07:56:03.550223 27824 rpcz_store.cc:276] 0928 07:55:58.609466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:58.609765 (+ 299us) service_pool.cc:224] Handling call
0928 07:55:59.863670 (+1253905us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:55:59.871513 (+ 7843us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:03.527079 (+3655566us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:03.548756 (+ 21677us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:03.549157 (+ 401us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:03.549657 (+ 500us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:03.533072 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:03.533619 (+ 547us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:03.533647 (+ 28us) write_op.cc:435] Acquired schema lock
0928 07:56:03.533660 (+ 13us) tablet.cc:662] Decoding operations
0928 07:56:03.533980 (+ 320us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:03.534023 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:03.534049 (+ 26us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:03.534275 (+ 226us) tablet.cc:701] Row locks acquired
0928 07:56:03.534293 (+ 18us) write_op.cc:260] PREPARE: finished
0928 07:56:03.534423 (+ 130us) write_op.cc:270] Start()
0928 07:56:03.534523 (+ 100us) write_op.cc:276] Timestamp: P: 1790582163534361 usec, L: 0
0928 07:56:03.534542 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 07:56:03.535087 (+ 545us) log.cc:844] Serialized 432 byte log entry
0928 07:56:03.546092 (+ 11005us) op_driver.cc:464] REPLICATION: finished
0928 07:56:03.546706 (+ 614us) write_op.cc:301] APPLY: starting
0928 07:56:03.546797 (+ 91us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:03.546977 (+ 180us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:03.547121 (+ 144us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:03.547807 (+ 686us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:03.548024 (+ 217us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:03.548078 (+ 54us) write_op.cc:312] APPLY: finished
0928 07:56:03.548276 (+ 198us) log.cc:844] Serialized 28 byte log entry
0928 07:56:03.548422 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:03.548497 (+ 75us) write_op.cc:454] Released schema lock
0928 07:56:03.548535 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:03.548776 (+ 241us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:03.548801 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":3188337,"Hive Metastore.run_cpu_time_us":763,"Hive Metastore.run_wall_time_us":466534,"child_traces":[["op",{"apply.queue_time_us":401,"apply.run_cpu_time_us":2042,"apply.run_wall_time_us":2042,"num_ops":2,"prepare.queue_time_us":3703,"prepare.run_cpu_time_us":2358,"prepare.run_wall_time_us":2374,"raft.queue_time_us":2571,"raft.run_cpu_time_us":724,"raft.run_wall_time_us":724,"replication_time_us":11436}]]}
I20260928 07:56:03.533890 28434 leader_election.cc:304] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
W20260928 07:56:03.564612 28434 raft_consensus.cc:2686] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 07:56:03.566533 28666 raft_consensus.cc:385] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.566649 28351 raft_consensus.cc:2468] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:03.568046 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:03.568859 28499 raft_consensus.cc:2393] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate acdaa3cf2ffd45f5b55a169c1bacead5 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:03.567121 28666 raft_consensus.cc:740] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.573276 28657 ts_tablet_manager.cc:1929] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.573738 28657 log.cc:1199] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/002fa916faa3453798288b9d53857b57
I20260928 07:56:03.574559 28657 ts_tablet_manager.cc:1950] T 002fa916faa3453798288b9d53857b57 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:03.585482 28657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 29) took 1754 ms. Trace:
I20260928 07:56:03.585942 28185 tablet_service.cc:1511] Processing CreateTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.587157 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55b0d19a14d42b5b02e4fcd3e6499c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.585853 28657 rpcz_store.cc:276] 0928 07:56:01.830664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:01.830848 (+ 184us) service_pool.cc:224] Handling call
0928 07:56:03.312127 (+1481279us) ts_tablet_manager.cc:1151] Deleting tablet 002fa916faa3453798288b9d53857b57
0928 07:56:03.312239 (+ 112us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:03.366750 (+ 54511us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.573124 (+206374us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.585398 (+ 12274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215,"tablet-delete.queue_time_us":1480569}
I20260928 07:56:03.586553 28477 tablet_service.cc:1511] Processing CreateTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.589881 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 002fa916faa3453798288b9d53857b57 (table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:03.590658 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55b0d19a14d42b5b02e4fcd3e6499c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.572892 28658 ts_tablet_manager.cc:1929] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.593734 28658 log.cc:1199] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/f21e8b5dc66f42109f6484aa6908c9be
I20260928 07:56:03.594413 28658 ts_tablet_manager.cc:1950] T f21e8b5dc66f42109f6484aa6908c9be P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:03.593405 27824 catalog_manager.cc:5838] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:03.571568 28666 consensus_queue.cc:260] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.596972 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:03.598143 28330 tablet_service.cc:1511] Processing CreateTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.598522 28657 tablet_replica.cc:333] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:03.599282 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55b0d19a14d42b5b02e4fcd3e6499c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.603669 28657 raft_consensus.cc:2243] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:03.597947 28658 tablet_replica.cc:333] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:03.611114 28658 raft_consensus.cc:2243] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.611687 28658 raft_consensus.cc:2272] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.611569 28657 pending_rounds.cc:70] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 1 pending ops.
I20260928 07:56:03.611971 28657 pending_rounds.cc:77] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224539096596480 op_type: NO_OP noop_request { }
I20260928 07:56:03.612397 28657 raft_consensus.cc:2889] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:03.612758 28657 raft_consensus.cc:2272] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.613982 28658 ts_tablet_manager.cc:1916] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.620801 28657 ts_tablet_manager.cc:1916] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.627913 27821 catalog_manager.cc:5838] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:03.631480 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet d2e295d50f83468184bb8edd29738907 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:03.645709 28434 leader_election.cc:304] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:03.646485 28677 raft_consensus.cc:2749] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 07:56:03.654501 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet d2e295d50f83468184bb8edd29738907
I20260928 07:56:03.660127 27822 catalog_manager.cc:6934] ReplaceTablet: tablet d2e295d50f83468184bb8edd29738907 deleted and replaced by tablet 242aa5fc7f7745b6905cbd0cc70e0b7a
I20260928 07:56:03.650326 27821 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:03.661600 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet d2e295d50f83468184bb8edd29738907 with delete_type TABLET_DATA_DELETED (replaced by tablet 242aa5fc7f7745b6905cbd0cc70e0b7a) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:03.662317 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet d2e295d50f83468184bb8edd29738907 with delete_type TABLET_DATA_DELETED (replaced by tablet 242aa5fc7f7745b6905cbd0cc70e0b7a) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:03.662839 28662 tablet_bootstrap.cc:492] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:03.663065 28656 tablet_replica.cc:333] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:03.663347 28662 ts_tablet_manager.cc:1403] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.335s user 0.011s sys 0.000s
I20260928 07:56:03.663785 28656 raft_consensus.cc:2243] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.664278 28656 raft_consensus.cc:2272] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.665940 28656 ts_tablet_manager.cc:1916] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.666304 28662 raft_consensus.cc:359] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.666978 28662 raft_consensus.cc:385] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.667266 28662 raft_consensus.cc:740] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.667972 28662 consensus_queue.cc:260] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.669787 28666 ts_tablet_manager.cc:1434] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.156s user 0.006s sys 0.000s
I20260928 07:56:03.681398 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet d2e295d50f83468184bb8edd29738907 with delete_type TABLET_DATA_DELETED (replaced by tablet 242aa5fc7f7745b6905cbd0cc70e0b7a) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:03.685525 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet ca01956e0d5141438038dc3f9110cc64 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:03.688148 28657 ts_tablet_manager.cc:1929] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:03.688549 28657 log.cc:1199] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/2188651a70264d7f876713e184a5bedb
I20260928 07:56:03.691351 28657 ts_tablet_manager.cc:1950] T 2188651a70264d7f876713e184a5bedb P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:03.694097 28657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 31) took 1585 ms. Trace:
I20260928 07:56:03.694415 28657 rpcz_store.cc:276] 0928 07:56:02.108444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:02.108597 (+ 153us) service_pool.cc:224] Handling call
0928 07:56:03.598354 (+1489757us) ts_tablet_manager.cc:1151] Deleting tablet 2188651a70264d7f876713e184a5bedb
0928 07:56:03.598410 (+ 56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:03.663421 (+ 65011us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.687894 (+ 24473us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.694037 (+ 6143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1489020}
I20260928 07:56:03.695724 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 2188651a70264d7f876713e184a5bedb (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:03.701735 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet ca01956e0d5141438038dc3f9110cc64
I20260928 07:56:03.706048 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet ca01956e0d5141438038dc3f9110cc64 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a68cdf4fe824e36ab54acd3dc62ad38) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:03.704444 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet ca01956e0d5141438038dc3f9110cc64 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a68cdf4fe824e36ab54acd3dc62ad38) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:03.706411 27822 catalog_manager.cc:6934] ReplaceTablet: tablet ca01956e0d5141438038dc3f9110cc64 deleted and replaced by tablet 0a68cdf4fe824e36ab54acd3dc62ad38
I20260928 07:56:03.706821 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet ca01956e0d5141438038dc3f9110cc64 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a68cdf4fe824e36ab54acd3dc62ad38) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:03.708752 28657 tablet_replica.cc:333] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:03.709479 28657 raft_consensus.cc:2243] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.709940 28657 raft_consensus.cc:2272] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.711664 28657 ts_tablet_manager.cc:1916] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.713603 28667 tablet_bootstrap.cc:492] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:03.714150 28667 ts_tablet_manager.cc:1403] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.383s user 0.012s sys 0.002s
I20260928 07:56:03.713165 28656 ts_tablet_manager.cc:1929] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 07:56:03.723541 28655 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 07:56:03.723980 28655 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
I20260928 07:56:03.723975 28656 log.cc:1199] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/d2e295d50f83468184bb8edd29738907
W20260928 07:56:03.724345 28655 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 07:56:03.724686 28655 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 07:56:03.724960 28656 ts_tablet_manager.cc:1950] T d2e295d50f83468184bb8edd29738907 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:03.726469 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 with delete_type TABLET_DATA_DELETED (replaced by tablet ca01956e0d5141438038dc3f9110cc64) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:03.729281 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet d2e295d50f83468184bb8edd29738907 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
W20260928 07:56:03.730924 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet ca01956e0d5141438038dc3f9110cc64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca01956e0d5141438038dc3f9110cc64 already in progress: creating tablet
W20260928 07:56:03.733989 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e48d66a1f934fb2aa6772d0ffcb0960 already in progress: creating tablet
I20260928 07:56:03.739389 28666 tablet_bootstrap.cc:492] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:03.742587 28662 ts_tablet_manager.cc:1434] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.079s user 0.005s sys 0.000s
I20260928 07:56:03.746307 28657 ts_tablet_manager.cc:1929] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.746701 28657 log.cc:1199] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/8e97445037aa466cb76e1e24d76ee6dd
I20260928 07:56:03.747130 28666 tablet_bootstrap.cc:654] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.747522 28657 ts_tablet_manager.cc:1950] T 8e97445037aa466cb76e1e24d76ee6dd P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:03.755070 28657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 33) took 1357 ms. Trace:
I20260928 07:56:03.755410 28657 rpcz_store.cc:276] 0928 07:56:02.397361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:02.397510 (+ 149us) service_pool.cc:224] Handling call
0928 07:56:03.708573 (+1311063us) ts_tablet_manager.cc:1151] Deleting tablet 8e97445037aa466cb76e1e24d76ee6dd
0928 07:56:03.708633 (+ 60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:03.732655 (+ 24022us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.746180 (+ 13525us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.755003 (+ 8823us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310358}
I20260928 07:56:03.758678 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 8e97445037aa466cb76e1e24d76ee6dd (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:03.758941 28657 tablet_replica.cc:333] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:03.759919 27822 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_84e7371229d1457d92d342b6b4e36a16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:03.765712 28657 raft_consensus.cc:2243] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.766233 28657 raft_consensus.cc:2272] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.766546 28662 tablet_bootstrap.cc:492] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:03.767958 28657 ts_tablet_manager.cc:1916] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.716670 28667 raft_consensus.cc:359] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.769559 28667 raft_consensus.cc:385] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.769846 28667 raft_consensus.cc:740] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.771752 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e48d66a1f934fb2aa6772d0ffcb0960 with delete_type TABLET_DATA_DELETED (replaced by tablet ca01956e0d5141438038dc3f9110cc64) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:03.772472 28656 tablet_replica.cc:333] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:03.773159 28656 raft_consensus.cc:2243] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.773635 28656 raft_consensus.cc:2272] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.775640 28656 ts_tablet_manager.cc:1916] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.773929 28667 consensus_queue.cc:260] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.792277 28658 ts_tablet_manager.cc:1929] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.792668 28658 log.cc:1199] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/c8213c2eadae427190bfc621d40ae1f6
I20260928 07:56:03.799768 28657 ts_tablet_manager.cc:1929] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.803244 28657 log.cc:1199] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/c4ccdaf195e64ddf88818da6b73a5aac
I20260928 07:56:03.804071 28657 ts_tablet_manager.cc:1950] T c4ccdaf195e64ddf88818da6b73a5aac P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:03.806012 28657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 35) took 1192 ms. Trace:
I20260928 07:56:03.806330 28657 rpcz_store.cc:276] 0928 07:56:02.613321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:02.613483 (+ 162us) service_pool.cc:224] Handling call
0928 07:56:03.758769 (+1145286us) ts_tablet_manager.cc:1151] Deleting tablet c4ccdaf195e64ddf88818da6b73a5aac
0928 07:56:03.758830 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:03.775364 (+ 16534us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.799645 (+ 24281us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:03.805953 (+ 6308us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1144598}
I20260928 07:56:03.807476 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet c4ccdaf195e64ddf88818da6b73a5aac (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:03.809139 27823 catalog_manager.cc:2213] created HMS catalog entry for table [id=2d81b3a1fd594d3687165ee0512c4625]
I20260928 07:56:03.821997 28657 tablet_replica.cc:333] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:03.822711 28657 raft_consensus.cc:2243] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.823189 28657 raft_consensus.cc:2272] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.824908 28657 ts_tablet_manager.cc:1916] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.833885 27823 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 10) took 5132 ms. Trace:
I20260928 07:56:03.834450 27823 rpcz_store.cc:276] 0928 07:55:58.701863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:58.702159 (+ 296us) service_pool.cc:224] Handling call
0928 07:55:59.866381 (+1164222us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:55:59.873956 (+ 7575us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:03.808975 (+3935019us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:03.833048 (+ 24073us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:03.833394 (+ 346us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:03.833820 (+ 426us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:03.811107 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:03.811516 (+ 409us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:03.811542 (+ 26us) write_op.cc:435] Acquired schema lock
0928 07:56:03.811559 (+ 17us) tablet.cc:662] Decoding operations
0928 07:56:03.811879 (+ 320us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:03.811920 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:03.811942 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:03.812148 (+ 206us) tablet.cc:701] Row locks acquired
0928 07:56:03.812161 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:03.812278 (+ 117us) write_op.cc:270] Start()
0928 07:56:03.812365 (+ 87us) write_op.cc:276] Timestamp: P: 1790582163812184 usec, L: 0
0928 07:56:03.812379 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 07:56:03.812877 (+ 498us) log.cc:844] Serialized 432 byte log entry
0928 07:56:03.830057 (+ 17180us) op_driver.cc:464] REPLICATION: finished
0928 07:56:03.831275 (+ 1218us) write_op.cc:301] APPLY: starting
0928 07:56:03.831338 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:03.831455 (+ 117us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:03.831553 (+ 98us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:03.831970 (+ 417us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:03.832119 (+ 149us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:03.832159 (+ 40us) write_op.cc:312] APPLY: finished
0928 07:56:03.832350 (+ 191us) log.cc:844] Serialized 28 byte log entry
0928 07:56:03.832500 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:03.832577 (+ 77us) write_op.cc:454] Released schema lock
0928 07:56:03.832610 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:03.832836 (+ 226us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:03.832860 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":3652487,"Hive Metastore.run_cpu_time_us":736,"Hive Metastore.run_wall_time_us":281737,"child_traces":[["op",{"apply.queue_time_us":1046,"apply.run_cpu_time_us":1527,"apply.run_wall_time_us":1527,"num_ops":2,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":2066,"prepare.run_wall_time_us":2067,"raft.queue_time_us":212,"raft.run_cpu_time_us":13,"raft.run_wall_time_us":13,"replication_time_us":17556}]]}
I20260928 07:56:03.844792 28773 raft_consensus.cc:493] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:03.845391 28773 raft_consensus.cc:515] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:03.849710 28286 leader_election.cc:343] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: c8213c2eadae427190bfc621d40ae1f6
I20260928 07:56:03.851263 28773 leader_election.cc:290] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:03.852947 28667 ts_tablet_manager.cc:1434] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.138s user 0.006s sys 0.000s
I20260928 07:56:03.857002 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8213c2eadae427190bfc621d40ae1f6" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:03.858954 28285 leader_election.cc:343] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: Tablet not RUNNING: STOPPED
I20260928 07:56:03.859489 28285 leader_election.cc:304] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:03.872046 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.873057 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.885928 28667 tablet_bootstrap.cc:492] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:03.889802 28657 ts_tablet_manager.cc:1929] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.890311 28657 log.cc:1199] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/f21e8b5dc66f42109f6484aa6908c9be
I20260928 07:56:03.891094 28657 ts_tablet_manager.cc:1950] T f21e8b5dc66f42109f6484aa6908c9be P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:03.894740 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.896155 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.896433 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a (DEFAULT_TABLE table=default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:03.897475 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:03.902212 28662 tablet_bootstrap.cc:700] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent opening tablet: real 0.104s user 0.002s sys 0.000s
I20260928 07:56:03.903645 28662 tablet_bootstrap.cc:654] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.905639 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 534a8d19fbe0460e98e4e61b3de13d6a from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:03.914304 28773 raft_consensus.cc:2749] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:03.917900 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet 3e48d66a1f934fb2aa6772d0ffcb0960 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:03.925604 28666 tablet_bootstrap.cc:492] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:03.926478 28666 ts_tablet_manager.cc:1403] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.187s user 0.008s sys 0.003s
I20260928 07:56:03.937861 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:03.938851 28657 tablet_replica.cc:333] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:03.939607 28657 raft_consensus.cc:2243] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:03.940088 28657 raft_consensus.cc:2272] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:03.941941 28657 ts_tablet_manager.cc:1916] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.946681 28658 ts_tablet_manager.cc:1950] T c8213c2eadae427190bfc621d40ae1f6 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:03.950390 28667 tablet_bootstrap.cc:654] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:03.968770 27823 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 534a8d19fbe0460e98e4e61b3de13d6a
I20260928 07:56:03.932148 28666 raft_consensus.cc:359] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:03.971565 28666 raft_consensus.cc:385] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:03.972134 28666 raft_consensus.cc:740] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:03.977631 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet c8213c2eadae427190bfc621d40ae1f6 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:03.978252 28656 ts_tablet_manager.cc:1929] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:03.978646 28656 log.cc:1199] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/3e48d66a1f934fb2aa6772d0ffcb0960
I20260928 07:56:03.982407 28656 ts_tablet_manager.cc:1950] T 3e48d66a1f934fb2aa6772d0ffcb0960 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:03.985921 28662 tablet_bootstrap.cc:492] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:03.986424 28662 ts_tablet_manager.cc:1403] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.220s user 0.012s sys 0.000s
I20260928 07:56:03.991904 28655 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.221.212:43659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:33315
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.221.252:41205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.221.252
--webserver_port=40429
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 07:43:23 UTC on e7f111948823
build id 14038
TSAN enabled
I20260928 07:56:03.996594 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 534a8d19fbe0460e98e4e61b3de13d6a with delete_type TABLET_DATA_DELETED (replaced by tablet 8535ad2fe942494bbd892e639d8882c4) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:03.997716 28655 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 07:56:03.997932 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 534a8d19fbe0460e98e4e61b3de13d6a with delete_type TABLET_DATA_DELETED (replaced by tablet 8535ad2fe942494bbd892e639d8882c4) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:03.998306 27823 catalog_manager.cc:6934] ReplaceTablet: tablet 534a8d19fbe0460e98e4e61b3de13d6a deleted and replaced by tablet 8535ad2fe942494bbd892e639d8882c4
I20260928 07:56:03.977631 28658 tablet_replica.cc:333] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:04.000007 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 534a8d19fbe0460e98e4e61b3de13d6a with delete_type TABLET_DATA_DELETED (replaced by tablet 8535ad2fe942494bbd892e639d8882c4) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:04.001008 28666 consensus_queue.cc:260] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.004823 28657 ts_tablet_manager.cc:1929] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.006955 28655 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260928 07:56:04.009416 28657 log.cc:1199] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/d97a4439c50f4c8e98baef9e98bb31d6
I20260928 07:56:04.010267 28657 ts_tablet_manager.cc:1950] T d97a4439c50f4c8e98baef9e98bb31d6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
W20260928 07:56:04.017940 27814 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f21e8b5dc66f42109f6484aa6908c9be consensus state has no leader
I20260928 07:56:04.018936 28666 ts_tablet_manager.cc:1434] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.092s user 0.006s sys 0.000s
I20260928 07:56:04.021482 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet d97a4439c50f4c8e98baef9e98bb31d6 (table default.table_d9b32ff27e7c49f1b841391b3e35ea50 [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:04.022919 28657 tablet_replica.cc:333] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:04.024852 28657 raft_consensus.cc:2243] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.028148 28658 raft_consensus.cc:2243] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.028724 28658 raft_consensus.cc:2272] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.030014 28657 raft_consensus.cc:2272] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.030484 28658 ts_tablet_manager.cc:1916] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.036434 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 3e48d66a1f934fb2aa6772d0ffcb0960 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:04.036733 28657 ts_tablet_manager.cc:1916] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:03.988992 28662 raft_consensus.cc:359] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.040293 28662 raft_consensus.cc:385] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.040627 28662 raft_consensus.cc:740] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.041596 28662 consensus_queue.cc:260] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.039492 28667 tablet_bootstrap.cc:492] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:04.043291 28667 ts_tablet_manager.cc:1403] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.158s user 0.007s sys 0.004s
I20260928 07:56:04.049023 28667 raft_consensus.cc:359] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.050755 27821 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_1bf0b919ff68446aae3e010b1984050d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:04.056785 28667 raft_consensus.cc:385] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.057145 28667 raft_consensus.cc:740] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.058040 28667 consensus_queue.cc:260] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.068154 28667 ts_tablet_manager.cc:1434] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260928 07:56:04.074519 28667 tablet_bootstrap.cc:492] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:04.080592 28677 raft_consensus.cc:493] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:04.081123 28677 raft_consensus.cc:515] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.083676 28677 leader_election.cc:290] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:04.087338 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2adff7db0fe54fc2bceb57fbc1f2fd72" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:04.087986 28351 raft_consensus.cc:2468] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:04.088923 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2adff7db0fe54fc2bceb57fbc1f2fd72" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:04.089682 28206 raft_consensus.cc:2468] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:04.091217 28667 tablet_bootstrap.cc:654] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.091674 28434 leader_election.cc:304] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:04.096712 28657 ts_tablet_manager.cc:1929] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.097092 28657 log.cc:1199] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/c8213c2eadae427190bfc621d40ae1f6
I20260928 07:56:04.097793 28657 ts_tablet_manager.cc:1950] T c8213c2eadae427190bfc621d40ae1f6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.099031 28677 raft_consensus.cc:2804] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:04.099519 28677 raft_consensus.cc:493] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:04.099948 28677 raft_consensus.cc:3060] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:04.107568 27828 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]
I20260928 07:56:04.107704 28677 raft_consensus.cc:515] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.111176 28657 tablet_replica.cc:333] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:04.111810 28657 raft_consensus.cc:2243] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.112207 28657 raft_consensus.cc:2272] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.113946 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet c8213c2eadae427190bfc621d40ae1f6 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:04.119009 28656 tablet_replica.cc:333] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:04.119863 28656 raft_consensus.cc:2243] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:04.123854 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.124908 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a68cdf4fe824e36ab54acd3dc62ad38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.135057 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet b55b0d19a14d42b5b02e4fcd3e6499c2 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:04.142536 28657 ts_tablet_manager.cc:1916] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.167657 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet b55b0d19a14d42b5b02e4fcd3e6499c2
I20260928 07:56:04.169492 27824 catalog_manager.cc:6934] ReplaceTablet: tablet b55b0d19a14d42b5b02e4fcd3e6499c2 deleted and replaced by tablet c67222a9df344ae48b94ea5e970fd9a8
I20260928 07:56:04.171640 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 with delete_type TABLET_DATA_DELETED (replaced by tablet c67222a9df344ae48b94ea5e970fd9a8) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:04.172034 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 with delete_type TABLET_DATA_DELETED (replaced by tablet c67222a9df344ae48b94ea5e970fd9a8) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:04.181839 28662 ts_tablet_manager.cc:1434] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.195s user 0.003s sys 0.002s
I20260928 07:56:04.193357 28351 raft_consensus.cc:1275] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Refusing update from remote peer acdaa3cf2ffd45f5b55a169c1bacead5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:04.194298 28656 pending_rounds.cc:70] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 2 pending ops.
I20260928 07:56:04.194725 28656 pending_rounds.cc:77] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7334224543977050112 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "534a8d19fbe0460e98e4e61b3de13d6a" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.table_5554a4e3daa34b5bae576237453e3c77" dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" new_extra_config { } }
W20260928 07:56:04.195991 28656 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54230: Aborted: Op aborted
I20260928 07:56:04.118558 28666 tablet_bootstrap.cc:492] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:04.170351 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 with delete_type TABLET_DATA_DELETED (replaced by tablet c67222a9df344ae48b94ea5e970fd9a8) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:04.192783 28499 raft_consensus.cc:1275] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Refusing update from remote peer acdaa3cf2ffd45f5b55a169c1bacead5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:04.212702 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 850394ead0474f0d8f89d039fa586a2d from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:04.224735 28657 ts_tablet_manager.cc:1929] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.225131 28657 log.cc:1199] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/3e48d66a1f934fb2aa6772d0ffcb0960
I20260928 07:56:04.233637 28657 ts_tablet_manager.cc:1950] T 3e48d66a1f934fb2aa6772d0ffcb0960 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.236399 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 3e48d66a1f934fb2aa6772d0ffcb0960 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:04.245647 28657 tablet_replica.cc:333] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:04.247901 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 850394ead0474f0d8f89d039fa586a2d
I20260928 07:56:04.253192 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.254469 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a68cdf4fe824e36ab54acd3dc62ad38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.249693 28657 raft_consensus.cc:2243] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.255848 28657 raft_consensus.cc:2272] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.258795 28657 ts_tablet_manager.cc:1916] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.274386 28667 tablet_bootstrap.cc:492] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:04.274824 28667 ts_tablet_manager.cc:1403] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.201s user 0.026s sys 0.007s
I20260928 07:56:04.277657 28667 raft_consensus.cc:359] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.278299 28667 raft_consensus.cc:385] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.278548 28667 raft_consensus.cc:740] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.278844 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2adff7db0fe54fc2bceb57fbc1f2fd72" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:04.279394 28351 raft_consensus.cc:3060] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:04.279345 28667 consensus_queue.cc:260] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.281608 28667 ts_tablet_manager.cc:1434] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260928 07:56:04.286520 28667 tablet_bootstrap.cc:492] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:04.300833 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 850394ead0474f0d8f89d039fa586a2d with delete_type TABLET_DATA_DELETED (replaced by tablet 2b14ce2207154262a8a6b4d7b7e1e137) from {username='slave'} at 127.0.0.1:60428
W20260928 07:56:04.306795 28781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 07:56:04.292337 28351 raft_consensus.cc:2468] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:04.308761 28434 leader_election.cc:304] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:04.319589 28782 raft_consensus.cc:493] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:04.320560 28782 raft_consensus.cc:515] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.323678 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 850394ead0474f0d8f89d039fa586a2d with delete_type TABLET_DATA_DELETED (replaced by tablet 2b14ce2207154262a8a6b4d7b7e1e137) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:04.328172 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.329298 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a68cdf4fe824e36ab54acd3dc62ad38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.336551 27820 catalog_manager.cc:2213] created HMS catalog entry for table [id=b359a82ae911436791cbd92ed60f305b]
I20260928 07:56:04.329139 28782 leader_election.cc:290] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:04.339366 28782 raft_consensus.cc:2804] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:04.340857 28782 raft_consensus.cc:697] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:04.341820 28782 consensus_queue.cc:237] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.354578 28667 tablet_bootstrap.cc:654] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.364548 28657 ts_tablet_manager.cc:1929] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.365033 28657 log.cc:1199] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/d2e295d50f83468184bb8edd29738907
I20260928 07:56:04.365895 28657 ts_tablet_manager.cc:1950] T d2e295d50f83468184bb8edd29738907 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.367653 27820 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 12) took 5391 ms. Trace:
I20260928 07:56:04.368022 27820 rpcz_store.cc:276] 0928 07:55:58.976621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:58.979946 (+ 3325us) service_pool.cc:224] Handling call
0928 07:56:00.206532 (+1226586us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:00.208572 (+ 2040us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:04.336385 (+4127813us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:04.366872 (+ 30487us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:04.367217 (+ 345us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:04.367590 (+ 373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:04.339028 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:04.339478 (+ 450us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:04.339504 (+ 26us) write_op.cc:435] Acquired schema lock
0928 07:56:04.339516 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:04.339807 (+ 291us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:04.339850 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:04.339870 (+ 20us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:04.340093 (+ 223us) tablet.cc:701] Row locks acquired
0928 07:56:04.340106 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:04.340218 (+ 112us) write_op.cc:270] Start()
0928 07:56:04.340313 (+ 95us) write_op.cc:276] Timestamp: P: 1790582164340130 usec, L: 0
0928 07:56:04.340331 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 07:56:04.340822 (+ 491us) log.cc:844] Serialized 432 byte log entry
0928 07:56:04.364331 (+ 23509us) op_driver.cc:464] REPLICATION: finished
0928 07:56:04.364687 (+ 356us) write_op.cc:301] APPLY: starting
0928 07:56:04.364741 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:04.364849 (+ 108us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:04.364948 (+ 99us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:04.366029 (+ 1081us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:04.366171 (+ 142us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:04.366213 (+ 42us) write_op.cc:312] APPLY: finished
0928 07:56:04.366415 (+ 202us) log.cc:844] Serialized 28 byte log entry
0928 07:56:04.366562 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:04.366634 (+ 72us) write_op.cc:454] Released schema lock
0928 07:56:04.366667 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:04.366896 (+ 229us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:04.366925 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":3897714,"Hive Metastore.run_cpu_time_us":685,"Hive Metastore.run_wall_time_us":229025,"child_traces":[["op",{"apply.queue_time_us":203,"apply.run_cpu_time_us":2091,"apply.run_wall_time_us":2175,"num_ops":2,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":2093,"prepare.run_wall_time_us":3273,"raft.queue_time_us":12195,"replication_time_us":23884}]]}
I20260928 07:56:04.380946 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a68cdf4fe824e36ab54acd3dc62ad38 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:04.381965 28677 leader_election.cc:290] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:04.385046 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 850394ead0474f0d8f89d039fa586a2d with delete_type TABLET_DATA_DELETED (replaced by tablet 2b14ce2207154262a8a6b4d7b7e1e137) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:04.391312 28434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 82685.8us
I20260928 07:56:04.409708 27824 catalog_manager.cc:6934] ReplaceTablet: tablet 850394ead0474f0d8f89d039fa586a2d deleted and replaced by tablet 2b14ce2207154262a8a6b4d7b7e1e137
I20260928 07:56:04.418917 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 49817bcae6d340d19817a14cf8cc0f98 (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.419991 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49817bcae6d340d19817a14cf8cc0f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.415366 28667 tablet_bootstrap.cc:492] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:04.420876 28667 ts_tablet_manager.cc:1403] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.135s user 0.006s sys 0.005s
I20260928 07:56:04.415733 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 49817bcae6d340d19817a14cf8cc0f98 (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.422091 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49817bcae6d340d19817a14cf8cc0f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.429533 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet d2e295d50f83468184bb8edd29738907 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
W20260928 07:56:04.430301 27815 catalog_manager.cc:5043] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet ca01956e0d5141438038dc3f9110cc64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca01956e0d5141438038dc3f9110cc64 already in progress: creating tablet
I20260928 07:56:04.434863 28657 tablet_replica.cc:333] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:04.435570 28657 raft_consensus.cc:2243] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.424773 28667 raft_consensus.cc:359] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.443290 28667 raft_consensus.cc:385] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.443605 28667 raft_consensus.cc:740] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.444252 28667 consensus_queue.cc:260] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.445811 28657 raft_consensus.cc:2272] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.271723 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 850394ead0474f0d8f89d039fa586a2d with delete_type TABLET_DATA_DELETED (replaced by tablet 2b14ce2207154262a8a6b4d7b7e1e137) from {username='slave'} at 127.0.0.1:54230
W20260928 07:56:04.453153 27815 catalog_manager.cc:5142] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): alter failed for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]): Aborted: Op aborted
I20260928 07:56:04.272181 28662 tablet_bootstrap.cc:492] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:04.274631 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2adff7db0fe54fc2bceb57fbc1f2fd72" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:04.454211 28206 raft_consensus.cc:3060] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:04.414152 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 49817bcae6d340d19817a14cf8cc0f98 (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.457950 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49817bcae6d340d19817a14cf8cc0f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.462322 28657 ts_tablet_manager.cc:1916] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.467397 28206 raft_consensus.cc:2468] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:04.467711 28667 ts_tablet_manager.cc:1434] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20260928 07:56:04.468612 28667 tablet_bootstrap.cc:492] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:04.489473 27823 catalog_manager.cc:5838] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:04.492234 28667 tablet_bootstrap.cc:654] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.519232 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 0a68cdf4fe824e36ab54acd3dc62ad38
I20260928 07:56:04.520869 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 0a68cdf4fe824e36ab54acd3dc62ad38 deleted and replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944
I20260928 07:56:04.522738 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:04.523221 28667 tablet_bootstrap.cc:492] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:04.523631 28667 ts_tablet_manager.cc:1403] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.006s
I20260928 07:56:04.527172 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:04.528651 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944) from {username='slave'} at 127.0.0.1:60428
W20260928 07:56:04.535606 28092 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2b14ce2207154262a8a6b4d7b7e1e137 has no consensus state
I20260928 07:56:04.547571 28657 ts_tablet_manager.cc:1929] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 07:56:04.550127 27816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.252:41205, user_credentials={real_user=slave}} blocked reactor thread for 159053us
W20260928 07:56:04.551818 28434 leader_election.cc:343] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 3e48d66a1f934fb2aa6772d0ffcb0960
I20260928 07:56:04.552826 28656 pending_rounds.cc:77] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224541869498368 op_type: NO_OP noop_request { }
I20260928 07:56:04.557552 28667 raft_consensus.cc:359] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:04.557003 28656 raft_consensus.cc:2889] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:04.561633 28667 raft_consensus.cc:385] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.555130 28666 tablet_bootstrap.cc:654] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.561923 28667 raft_consensus.cc:740] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.562623 28667 consensus_queue.cc:260] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:04.566272 28657 log.cc:1199] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/534a8d19fbe0460e98e4e61b3de13d6a
I20260928 07:56:04.568475 28656 raft_consensus.cc:2272] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.569003 28657 ts_tablet_manager.cc:1950] T 534a8d19fbe0460e98e4e61b3de13d6a P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.572124 28667 ts_tablet_manager.cc:1434] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.048s user 0.006s sys 0.000s
I20260928 07:56:04.578336 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:04.580987 28667 tablet_bootstrap.cc:492] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:04.581113 28092 catalog_manager.cc:2811] Deleting table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361] in response to Hive Metastore notification log event 7
I20260928 07:56:04.584312 27820 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_08d1c01076584e7b991014697596a21e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 07:56:04.588406 28434 leader_election.cc:343] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 3e48d66a1f934fb2aa6772d0ffcb0960
I20260928 07:56:04.589123 28434 leader_election.cc:304] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:04.590169 28782 raft_consensus.cc:2749] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:04.590484 28657 tablet_replica.cc:333] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:04.591179 28657 raft_consensus.cc:2243] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.591660 28657 raft_consensus.cc:2272] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:04.592059 28434 consensus_peers.cc:597] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2e295d50f83468184bb8edd29738907. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:04.604602 28657 ts_tablet_manager.cc:1916] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.611666 28667 tablet_bootstrap.cc:654] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.623301 28656 ts_tablet_manager.cc:1916] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.633036 28667 tablet_bootstrap.cc:492] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:04.637619 28662 tablet_bootstrap.cc:654] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.633509 28667 ts_tablet_manager.cc:1403] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.053s user 0.006s sys 0.005s
I20260928 07:56:04.642238 28667 raft_consensus.cc:359] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.649430 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet ca01956e0d5141438038dc3f9110cc64 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a68cdf4fe824e36ab54acd3dc62ad38) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:04.652158 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a68cdf4fe824e36ab54acd3dc62ad38 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:04.642900 28667 raft_consensus.cc:385] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.658157 28667 raft_consensus.cc:740] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.659730 28667 consensus_queue.cc:260] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:04.663324 28434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 71701.7us
I20260928 07:56:04.667271 28667 ts_tablet_manager.cc:1434] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.029s user 0.004s sys 0.002s
I20260928 07:56:04.668141 28667 tablet_bootstrap.cc:492] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:04.672814 28657 ts_tablet_manager.cc:1929] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.673187 28657 log.cc:1199] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/b55b0d19a14d42b5b02e4fcd3e6499c2
I20260928 07:56:04.673889 28657 ts_tablet_manager.cc:1950] T b55b0d19a14d42b5b02e4fcd3e6499c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.700009 28657 tablet_replica.cc:333] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:04.700246 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet b55b0d19a14d42b5b02e4fcd3e6499c2 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:04.700722 28657 raft_consensus.cc:2243] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.704927 28667 tablet_bootstrap.cc:654] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.701282 28657 raft_consensus.cc:2272] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.713872 28666 tablet_bootstrap.cc:492] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:04.714390 28666 ts_tablet_manager.cc:1403] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.596s user 0.006s sys 0.005s
I20260928 07:56:04.716648 28657 ts_tablet_manager.cc:1916] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.720080 28666 raft_consensus.cc:359] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.721415 28666 raft_consensus.cc:385] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.729386 28667 tablet_bootstrap.cc:492] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:04.729480 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:04 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:04.729846 28667 ts_tablet_manager.cc:1403] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.062s user 0.010s sys 0.000s
I20260928 07:56:04.740389 28667 raft_consensus.cc:359] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.741101 28667 raft_consensus.cc:385] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.741398 28667 raft_consensus.cc:740] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.751134 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 242aa5fc7f7745b6905cbd0cc70e0b7a from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:04.754419 28092 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 2adff7db0fe54fc2bceb57fbc1f2fd72
I20260928 07:56:04.742038 28667 consensus_queue.cc:260] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.756479 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:04 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:04.759084 28773 raft_consensus.cc:493] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:04.759581 28773 raft_consensus.cc:515] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.761615 28773 leader_election.cc:290] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:04.762212 28667 ts_tablet_manager.cc:1434] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260928 07:56:04.763727 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242aa5fc7f7745b6905cbd0cc70e0b7a" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:04.764091 28667 tablet_bootstrap.cc:492] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
W20260928 07:56:04.765268 28286 leader_election.cc:343] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:04.777549 28773 raft_consensus.cc:493] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:04.778102 28773 raft_consensus.cc:515] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.780508 28657 ts_tablet_manager.cc:1929] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.780931 28657 log.cc:1199] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/850394ead0474f0d8f89d039fa586a2d
I20260928 07:56:04.781123 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a68cdf4fe824e36ab54acd3dc62ad38" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:04.783660 28286 leader_election.cc:343] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:04.784399 28773 leader_election.cc:290] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:04.784754 28667 tablet_bootstrap.cc:654] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.785079 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 with delete_type TABLET_DATA_DELETED (replaced by tablet c67222a9df344ae48b94ea5e970fd9a8) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:04.786675 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242aa5fc7f7745b6905cbd0cc70e0b7a" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:04.787858 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a68cdf4fe824e36ab54acd3dc62ad38" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:04.791136 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:04 UTC) from {username='slave'} at 127.0.0.1:60428
W20260928 07:56:04.788585 28434 consensus_peers.cc:597] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e -> Peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Couldn't send request to peer 3bd67de620c94af3b7c8e3ba7d42f980. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2e295d50f83468184bb8edd29738907. This is attempt 1: this message will repeat every 5th retry.
W20260928 07:56:04.792203 28285 leader_election.cc:343] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:04.792647 28285 leader_election.cc:304] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:04.794111 28773 raft_consensus.cc:2749] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 07:56:04.794303 28285 leader_election.cc:343] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:04.793752 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:04 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:04.794703 28285 leader_election.cc:304] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:04.794693 28657 ts_tablet_manager.cc:1950] T 850394ead0474f0d8f89d039fa586a2d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.795401 28773 raft_consensus.cc:2749] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:04.796171 28666 raft_consensus.cc:740] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.797919 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 850394ead0474f0d8f89d039fa586a2d (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:04.798120 28657 tablet_replica.cc:333] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
W20260928 07:56:04.799050 27815 catalog_manager.cc:5030] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet 850394ead0474f0d8f89d039fa586a2d because the tablet was not found. No further retry: Not found: Tablet not found: 850394ead0474f0d8f89d039fa586a2d
I20260928 07:56:04.798873 28666 consensus_queue.cc:260] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.803840 28092 catalog_manager.cc:2811] Deleting table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4] in response to Hive Metastore notification log event 11
I20260928 07:56:04.810279 28662 tablet_bootstrap.cc:492] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:04.810431 28657 raft_consensus.cc:2243] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.810953 28657 raft_consensus.cc:2272] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.811398 28662 ts_tablet_manager.cc:1403] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.539s user 0.006s sys 0.007s
I20260928 07:56:04.811884 28658 ts_tablet_manager.cc:1929] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.812254 28658 log.cc:1199] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/d97a4439c50f4c8e98baef9e98bb31d6
I20260928 07:56:04.812934 28658 ts_tablet_manager.cc:1950] T d97a4439c50f4c8e98baef9e98bb31d6 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:04.814392 28666 ts_tablet_manager.cc:1434] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.097s user 0.004s sys 0.001s
I20260928 07:56:04.815442 28657 ts_tablet_manager.cc:1916] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.816478 28667 tablet_bootstrap.cc:492] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:04.815630 28662 raft_consensus.cc:359] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.817570 28667 ts_tablet_manager.cc:1403] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.054s user 0.010s sys 0.002s
I20260928 07:56:04.820595 28667 raft_consensus.cc:359] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.821367 28662 raft_consensus.cc:385] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.821696 28662 raft_consensus.cc:740] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.822444 28662 consensus_queue.cc:260] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.824791 28667 raft_consensus.cc:385] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:04.825109 28667 raft_consensus.cc:740] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:04.825954 28667 consensus_queue.cc:260] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:04.828274 28667 ts_tablet_manager.cc:1434] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260928 07:56:04.830839 28666 tablet_bootstrap.cc:492] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:04.844756 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 39) took 1631 ms. Trace:
I20260928 07:56:04.845281 28656 ts_tablet_manager.cc:1929] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:04.845132 28658 rpcz_store.cc:276] 0928 07:56:03.213721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:03.213880 (+ 159us) service_pool.cc:224] Handling call
0928 07:56:03.977305 (+763425us) ts_tablet_manager.cc:1151] Deleting tablet d97a4439c50f4c8e98baef9e98bb31d6
0928 07:56:03.977415 (+ 110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:04.596444 (+619029us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:04.811746 (+215302us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:04.844686 (+ 32940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26248,"tablet-delete.queue_time_us":762823}
I20260928 07:56:04.846060 28656 log.cc:1199] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/534a8d19fbe0460e98e4e61b3de13d6a
I20260928 07:56:04.846695 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet d97a4439c50f4c8e98baef9e98bb31d6 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:04.846899 28656 ts_tablet_manager.cc:1950] T 534a8d19fbe0460e98e4e61b3de13d6a P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:04.848654 28666 tablet_bootstrap.cc:654] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:04.849557 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:04.849255 28658 tablet_replica.cc:333] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
W20260928 07:56:04.852243 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b55b0d19a14d42b5b02e4fcd3e6499c2 already in progress: creating tablet
I20260928 07:56:04.852510 28658 raft_consensus.cc:2243] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.854166 28658 raft_consensus.cc:2272] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:04.854152 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 850394ead0474f0d8f89d039fa586a2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 850394ead0474f0d8f89d039fa586a2d already in progress: creating tablet
I20260928 07:56:04.844971 28657 ts_tablet_manager.cc:1929] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.855059 28657 log.cc:1199] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/0a68cdf4fe824e36ab54acd3dc62ad38
W20260928 07:56:04.855890 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a68cdf4fe824e36ab54acd3dc62ad38 already in progress: creating tablet
I20260928 07:56:04.855934 28657 ts_tablet_manager.cc:1950] T 0a68cdf4fe824e36ab54acd3dc62ad38 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.856910 28656 tablet_replica.cc:333] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:04.857718 28656 raft_consensus.cc:2243] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.858201 28656 raft_consensus.cc:2272] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.858753 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 0a68cdf4fe824e36ab54acd3dc62ad38 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:04.860383 28656 ts_tablet_manager.cc:1916] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.860965 28658 ts_tablet_manager.cc:1916] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.863049 28662 ts_tablet_manager.cc:1434] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.051s user 0.006s sys 0.002s
I20260928 07:56:04.865541 28657 tablet_replica.cc:333] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:04.866271 28657 raft_consensus.cc:2243] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.866776 28657 raft_consensus.cc:2272] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.872009 28657 ts_tablet_manager.cc:1916] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.875552 28662 tablet_bootstrap.cc:492] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:04.875718 28656 ts_tablet_manager.cc:1929] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.876156 28656 log.cc:1199] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/2adff7db0fe54fc2bceb57fbc1f2fd72
I20260928 07:56:04.876950 28656 ts_tablet_manager.cc:1950] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
W20260928 07:56:04.880362 27815 catalog_manager.cc:5030] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 because the tablet was not found. No further retry: Not found: Tablet not found: 2adff7db0fe54fc2bceb57fbc1f2fd72
I20260928 07:56:04.901889 28658 ts_tablet_manager.cc:1929] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.902292 28658 log.cc:1199] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/3e48d66a1f934fb2aa6772d0ffcb0960
I20260928 07:56:04.902940 28658 ts_tablet_manager.cc:1950] T 3e48d66a1f934fb2aa6772d0ffcb0960 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:04.904912 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 42) took 1429 ms. Trace:
I20260928 07:56:04.905244 28658 rpcz_store.cc:276] 0928 07:56:03.475955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:03.476095 (+ 140us) service_pool.cc:224] Handling call
0928 07:56:04.849068 (+1372973us) ts_tablet_manager.cc:1151] Deleting tablet 3e48d66a1f934fb2aa6772d0ffcb0960
0928 07:56:04.849115 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:04.893434 (+ 44319us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:04.901756 (+ 8322us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:04.904852 (+ 3096us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1370098}
I20260928 07:56:04.906417 28658 tablet_replica.cc:333] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:04.907135 28658 raft_consensus.cc:2243] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:04.908335 28658 pending_rounds.cc:70] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Trying to abort 1 pending ops.
I20260928 07:56:04.908577 28658 pending_rounds.cc:77] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224541662605312 op_type: NO_OP noop_request { }
I20260928 07:56:04.908854 28657 ts_tablet_manager.cc:1929] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.908942 28658 raft_consensus.cc:2889] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:04.909405 28658 raft_consensus.cc:2272] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.909921 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 3e48d66a1f934fb2aa6772d0ffcb0960 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:04.911361 28658 ts_tablet_manager.cc:1916] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.909195 28657 log.cc:1199] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/ca01956e0d5141438038dc3f9110cc64
I20260928 07:56:04.917799 28657 ts_tablet_manager.cc:1950] T ca01956e0d5141438038dc3f9110cc64 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.920542 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet ca01956e0d5141438038dc3f9110cc64 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:04.923527 28187 tablet_service.cc:1511] Processing CreateTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.925319 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67222a9df344ae48b94ea5e970fd9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.927232 28658 ts_tablet_manager.cc:1929] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:04.927626 28658 log.cc:1199] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/d2e295d50f83468184bb8edd29738907
I20260928 07:56:04.928630 28658 ts_tablet_manager.cc:1950] T d2e295d50f83468184bb8edd29738907 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:04.930856 28479 tablet_service.cc:1511] Processing CreateTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.932065 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67222a9df344ae48b94ea5e970fd9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.932286 28331 tablet_service.cc:1511] Processing CreateTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.934485 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3aad1a314d4cc39b9b2e42a3022944 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.937567 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3aad1a314d4cc39b9b2e42a3022944 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.939081 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3aad1a314d4cc39b9b2e42a3022944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.940250 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 45) took 1279 ms. Trace:
I20260928 07:56:04.941637 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67222a9df344ae48b94ea5e970fd9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.940600 28658 rpcz_store.cc:276] 0928 07:56:03.661136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:03.661461 (+ 325us) service_pool.cc:224] Handling call
0928 07:56:04.906246 (+1244785us) ts_tablet_manager.cc:1151] Deleting tablet d2e295d50f83468184bb8edd29738907
0928 07:56:04.906288 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:04.920003 (+ 13715us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:04.927084 (+ 7081us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:04.940170 (+ 13086us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1244233}
I20260928 07:56:04.944430 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet d2e295d50f83468184bb8edd29738907 (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:04.944607 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3aad1a314d4cc39b9b2e42a3022944 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.945719 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3aad1a314d4cc39b9b2e42a3022944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.945729 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3aad1a314d4cc39b9b2e42a3022944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.948817 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 46) took 1244 ms. Trace:
I20260928 07:56:04.949139 28658 rpcz_store.cc:276] 0928 07:56:03.704058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:03.704286 (+ 228us) service_pool.cc:224] Handling call
0928 07:56:04.948370 (+1244084us) ts_tablet_manager.cc:1151] Deleting tablet ca01956e0d5141438038dc3f9110cc64
0928 07:56:04.948429 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:04.948760 (+ 331us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1238531}
W20260928 07:56:04.950613 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet ca01956e0d5141438038dc3f9110cc64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca01956e0d5141438038dc3f9110cc64 already in progress: creating tablet
I20260928 07:56:04.951685 28658 tablet_replica.cc:333] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:04.952430 28658 raft_consensus.cc:2243] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.953462 28658 raft_consensus.cc:2272] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:04.958367 28658 ts_tablet_manager.cc:1916] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.970171 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.971201 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14ce2207154262a8a6b4d7b7e1e137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.972597 28658 ts_tablet_manager.cc:1929] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.973006 28658 log.cc:1199] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/534a8d19fbe0460e98e4e61b3de13d6a
I20260928 07:56:04.973737 28658 ts_tablet_manager.cc:1950] T 534a8d19fbe0460e98e4e61b3de13d6a P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:04.976470 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
W20260928 07:56:04.978251 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b55b0d19a14d42b5b02e4fcd3e6499c2 already in progress: creating tablet
I20260928 07:56:04.979478 28658 tablet_replica.cc:333] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:04.980139 28658 raft_consensus.cc:2243] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:04.980643 28658 raft_consensus.cc:2272] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:04.982247 27815 catalog_manager.cc:5136] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): alter failed for tablet 534a8d19fbe0460e98e4e61b3de13d6a (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]),no further retry: Not found: Tablet not found: 534a8d19fbe0460e98e4e61b3de13d6a
I20260928 07:56:04.982858 28658 ts_tablet_manager.cc:1916] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:04.985190 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:04.986284 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14ce2207154262a8a6b4d7b7e1e137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:04.998713 28658 ts_tablet_manager.cc:1929] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:04.999464 28658 log.cc:1199] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/850394ead0474f0d8f89d039fa586a2d
I20260928 07:56:04.999749 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 242aa5fc7f7745b6905cbd0cc70e0b7a
I20260928 07:56:05.000319 28658 ts_tablet_manager.cc:1950] T 850394ead0474f0d8f89d039fa586a2d P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:05.001477 27824 catalog_manager.cc:6934] ReplaceTablet: tablet 242aa5fc7f7745b6905cbd0cc70e0b7a deleted and replaced by tablet a018e7ed93784490a5510bafd25348df
I20260928 07:56:05.002636 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a with delete_type TABLET_DATA_DELETED (replaced by tablet a018e7ed93784490a5510bafd25348df) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:05.004786 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 850394ead0474f0d8f89d039fa586a2d (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
W20260928 07:56:05.006695 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a68cdf4fe824e36ab54acd3dc62ad38 already in progress: creating tablet
I20260928 07:56:05.008047 28657 tablet_replica.cc:333] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:05.008842 28657 raft_consensus.cc:2243] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.008862 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 850394ead0474f0d8f89d039fa586a2d with delete_type TABLET_DATA_DELETED (replaced by tablet 2b14ce2207154262a8a6b4d7b7e1e137) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:05.009853 28658 tablet_replica.cc:333] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:05.011318 28658 raft_consensus.cc:2243] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:05.014374 28658 pending_rounds.cc:70] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Trying to abort 1 pending ops.
I20260928 07:56:05.014679 28658 pending_rounds.cc:77] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224545243688960 op_type: NO_OP noop_request { }
I20260928 07:56:05.015103 28658 raft_consensus.cc:2889] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:05.015527 28658 raft_consensus.cc:2272] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.019901 28667 tablet_bootstrap.cc:492] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:05.020195 28657 raft_consensus.cc:2272] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.022246 28657 ts_tablet_manager.cc:1916] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:05.023767 27815 catalog_manager.cc:5030] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 because the tablet was not found. No further retry: Not found: Tablet not found: b55b0d19a14d42b5b02e4fcd3e6499c2
I20260928 07:56:05.025269 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a with delete_type TABLET_DATA_DELETED (replaced by tablet a018e7ed93784490a5510bafd25348df) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:05.026583 28800 raft_consensus.cc:493] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:05.026989 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 850394ead0474f0d8f89d039fa586a2d with delete_type TABLET_DATA_DELETED (replaced by tablet 2b14ce2207154262a8a6b4d7b7e1e137) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:05.027033 28800 raft_consensus.cc:515] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.029189 28800 leader_election.cc:290] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:05.029703 28656 tablet_replica.cc:333] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:05.032971 28656 raft_consensus.cc:2243] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.033425 28656 raft_consensus.cc:2272] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:05.031822 28142 leader_election.cc:343] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 850394ead0474f0d8f89d039fa586a2d
I20260928 07:56:05.037400 28656 ts_tablet_manager.cc:1916] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.038028 28092 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet a018e7ed93784490a5510bafd25348df
W20260928 07:56:05.041842 28141 leader_election.cc:343] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Not found: Tablet not found: 850394ead0474f0d8f89d039fa586a2d
I20260928 07:56:05.043203 28667 tablet_bootstrap.cc:654] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.043628 28141 leader_election.cc:304] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:05.047214 28328 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944) from {username='slave'} at 127.0.0.1:60428
W20260928 07:56:05.048794 28141 raft_consensus.cc:2686] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 07:56:05.056691 28658 ts_tablet_manager.cc:1916] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.062924 28667 tablet_bootstrap.cc:492] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:05.063372 28667 ts_tablet_manager.cc:1403] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.000s
W20260928 07:56:05.063645 27814 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f21e8b5dc66f42109f6484aa6908c9be consensus state has no leader
I20260928 07:56:05.019289 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a68cdf4fe824e36ab54acd3dc62ad38 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:05.067088 28667 raft_consensus.cc:359] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.073830 28667 raft_consensus.cc:385] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.074200 28667 raft_consensus.cc:740] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.075054 28667 consensus_queue.cc:260] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.081370 28667 ts_tablet_manager.cc:1434] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.018s user 0.007s sys 0.001s
I20260928 07:56:05.088052 27829 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 6) took 6670 ms. Trace:
I20260928 07:56:05.088632 28667 tablet_bootstrap.cc:492] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:05.088407 27829 rpcz_store.cc:276] 0928 07:55:58.417675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:58.431885 (+ 14210us) service_pool.cc:224] Handling call
0928 07:55:59.858602 (+1426717us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:05.085913 (+5227311us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:05.086938 (+ 1025us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:05.087860 (+ 922us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":15749,"Hive Metastore.run_cpu_time_us":1956,"Hive Metastore.run_wall_time_us":385882}
I20260928 07:56:05.090202 28656 ts_tablet_manager.cc:1929] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.095552 28656 log.cc:1199] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/850394ead0474f0d8f89d039fa586a2d
I20260928 07:56:05.099345 28656 ts_tablet_manager.cc:1950] T 850394ead0474f0d8f89d039fa586a2d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:05.101361 27827 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 8) took 6601 ms. Trace:
W20260928 07:56:05.102000 27825 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_182658f932d9407599c8db9fcee8c679 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:05.101712 27827 rpcz_store.cc:276] 0928 07:55:58.500309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:58.503578 (+ 3269us) service_pool.cc:224] Handling call
0928 07:55:59.861331 (+1357753us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:05.101202 (+5239871us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":399416,"Hive Metastore.run_cpu_time_us":1072,"Hive Metastore.run_wall_time_us":2652310}
W20260928 07:56:05.107201 27822 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_84e7371229d1457d92d342b6b4e36a16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:56:05.107249 27821 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1bf0b919ff68446aae3e010b1984050d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:05.108031 27828 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 11) took 6337 ms. Trace:
I20260928 07:56:05.108355 27828 rpcz_store.cc:276] 0928 07:55:58.770799 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:55:58.780480 (+ 9681us) service_pool.cc:224] Handling call
0928 07:56:00.203725 (+1423245us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:05.107944 (+4904219us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":3604397,"Hive Metastore.run_cpu_time_us":418,"Hive Metastore.run_wall_time_us":297801}
W20260928 07:56:05.109247 27820 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_08d1c01076584e7b991014697596a21e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:05.086462 28657 ts_tablet_manager.cc:1929] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.115939 28657 log.cc:1199] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/2adff7db0fe54fc2bceb57fbc1f2fd72
I20260928 07:56:05.116775 28657 ts_tablet_manager.cc:1950] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:04.862017 28666 tablet_bootstrap.cc:492] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:05.125662 28666 ts_tablet_manager.cc:1403] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.295s user 0.007s sys 0.003s
I20260928 07:56:05.128333 28666 raft_consensus.cc:359] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.132844 28667 tablet_bootstrap.cc:654] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.133832 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
W20260928 07:56:05.134725 27815 catalog_manager.cc:5030] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 because the tablet was not found. No further retry: Not found: Tablet not found: 0a68cdf4fe824e36ab54acd3dc62ad38
I20260928 07:56:05.137770 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 850394ead0474f0d8f89d039fa586a2d (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:05.153990 28662 tablet_bootstrap.cc:654] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.155704 28667 tablet_bootstrap.cc:492] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:05.156157 28667 ts_tablet_manager.cc:1403] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.069s user 0.009s sys 0.000s
I20260928 07:56:05.161697 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a with delete_type TABLET_DATA_DELETED (replaced by tablet a018e7ed93784490a5510bafd25348df) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:05.162600 28657 tablet_replica.cc:333] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:05.163275 28657 raft_consensus.cc:2243] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.163722 28657 raft_consensus.cc:2272] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.165897 28657 ts_tablet_manager.cc:1916] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.167098 28667 raft_consensus.cc:359] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.167706 28667 raft_consensus.cc:385] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.167970 28667 raft_consensus.cc:740] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.170351 28667 consensus_queue.cc:260] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:05.184554 27815 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 46796.8us
I20260928 07:56:05.187026 28667 ts_tablet_manager.cc:1434] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.031s user 0.007s sys 0.000s
I20260928 07:56:05.189653 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 01999d17e6c94da586343fc9daa5a59f (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.190867 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01999d17e6c94da586343fc9daa5a59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.192274 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 8535ad2fe942494bbd892e639d8882c4 (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.193363 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8535ad2fe942494bbd892e639d8882c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.198210 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 01999d17e6c94da586343fc9daa5a59f (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.199575 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01999d17e6c94da586343fc9daa5a59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.145367 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.203519 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14ce2207154262a8a6b4d7b7e1e137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.146929 28658 ts_tablet_manager.cc:1929] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:05.205556 28658 log.cc:1199] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/2adff7db0fe54fc2bceb57fbc1f2fd72
I20260928 07:56:05.206357 28658 ts_tablet_manager.cc:1950] T 2adff7db0fe54fc2bceb57fbc1f2fd72 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:05.150589 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 01999d17e6c94da586343fc9daa5a59f (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.209707 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01999d17e6c94da586343fc9daa5a59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.211447 28773 raft_consensus.cc:493] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:05.211922 28773 raft_consensus.cc:515] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.214097 28773 leader_election.cc:290] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:05.215349 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 2adff7db0fe54fc2bceb57fbc1f2fd72 (table default.table_ccb180d575274679b4d4cfbdc4622d34 [id=9241655678a6423ea1a261d4630fd361]) successfully deleted
I20260928 07:56:05.215935 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49817bcae6d340d19817a14cf8cc0f98" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:05.217401 27814 catalog_manager.cc:5030] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 850394ead0474f0d8f89d039fa586a2d because the tablet was not found. No further retry: Not found: Tablet not found: 850394ead0474f0d8f89d039fa586a2d
W20260928 07:56:05.217561 28285 leader_election.cc:343] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:05.219465 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49817bcae6d340d19817a14cf8cc0f98" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:05.221094 28286 leader_election.cc:343] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:05.221517 28286 leader_election.cc:304] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:05.222656 28773 raft_consensus.cc:2749] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:05.241351 28666 raft_consensus.cc:385] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.241688 28666 raft_consensus.cc:740] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.242626 28666 consensus_queue.cc:260] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.254618 28476 tablet_service.cc:1558] Processing DeleteTablet for tablet ca01956e0d5141438038dc3f9110cc64 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a68cdf4fe824e36ab54acd3dc62ad38) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:05.255036 28666 ts_tablet_manager.cc:1434] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.129s user 0.004s sys 0.001s
I20260928 07:56:05.255756 28658 tablet_replica.cc:333] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:05.256523 28658 raft_consensus.cc:2243] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.257050 28658 raft_consensus.cc:2272] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.259333 28658 ts_tablet_manager.cc:1916] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.284436 28662 tablet_bootstrap.cc:492] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:05.284886 28662 ts_tablet_manager.cc:1403] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.410s user 0.009s sys 0.000s
I20260928 07:56:05.288722 28667 tablet_bootstrap.cc:492] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:05.295151 28667 tablet_bootstrap.cc:654] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.302340 27826 catalog_manager.cc:3541] renamed table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed] in HMS: new name default.table_90fcf6263808404eba291d0ffe2cc50e
I20260928 07:56:05.307503 27828 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a68cdf4fe824e36ab54acd3dc62ad38 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:05.309748 27828 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_b683bb3b8dc3479ea1bb3735c0fb55af" } new_table_name: "default.Table_579ed77832b347ea98ea15d75bc5775d" modify_external_catalogs: true
I20260928 07:56:05.318251 28657 ts_tablet_manager.cc:1929] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 07:56:05.318535 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260928 07:56:05.318776 28657 log.cc:1199] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/242aa5fc7f7745b6905cbd0cc70e0b7a
I20260928 07:56:05.319664 28657 ts_tablet_manager.cc:1950] T 242aa5fc7f7745b6905cbd0cc70e0b7a P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:05.320847 28667 tablet_bootstrap.cc:492] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:05.321295 28667 ts_tablet_manager.cc:1403] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.006s
I20260928 07:56:05.322176 28662 raft_consensus.cc:359] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.322891 28662 raft_consensus.cc:385] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.323843 28667 raft_consensus.cc:359] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.323172 28662 raft_consensus.cc:740] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.324757 28667 raft_consensus.cc:385] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.325070 28667 raft_consensus.cc:740] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.325006 27829 master_service.cc:960] ReplaceTablet: received request to replace tablet b55b0d19a14d42b5b02e4fcd3e6499c2 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:05.325704 28667 consensus_queue.cc:260] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.324250 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 8535ad2fe942494bbd892e639d8882c4 (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.329543 28667 ts_tablet_manager.cc:1434] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260928 07:56:05.325198 28662 consensus_queue.cc:260] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.336078 28662 ts_tablet_manager.cc:1434] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.051s user 0.005s sys 0.003s
I20260928 07:56:05.337090 28662 tablet_bootstrap.cc:492] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:05.343924 28662 tablet_bootstrap.cc:654] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.351269 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet ca01956e0d5141438038dc3f9110cc64 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a68cdf4fe824e36ab54acd3dc62ad38) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:05.352550 28656 tablet_replica.cc:333] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:05.353958 27827 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_6ba15b125765407a97c61d226b03034e" } modify_external_catalogs: true
I20260928 07:56:05.355108 27827 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_6ba15b125765407a97c61d226b03034e" } modify_external_catalogs: true
I20260928 07:56:05.356393 27829 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_e97da6ec4ba84945a7e55b4a764d1606" } modify_external_catalogs: true
I20260928 07:56:05.357251 27829 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_e97da6ec4ba84945a7e55b4a764d1606" } modify_external_catalogs: true
I20260928 07:56:05.358469 28656 raft_consensus.cc:2243] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.359000 28656 raft_consensus.cc:2272] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.360414 28667 tablet_bootstrap.cc:492] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:05.362619 28656 ts_tablet_manager.cc:1916] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.368041 28667 tablet_bootstrap.cc:654] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.378410 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8535ad2fe942494bbd892e639d8882c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.385660 28667 tablet_bootstrap.cc:492] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:05.386109 28667 ts_tablet_manager.cc:1403] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.006s
I20260928 07:56:05.388513 28667 raft_consensus.cc:359] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.389130 28667 raft_consensus.cc:385] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.396593 28667 raft_consensus.cc:740] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.397634 28667 consensus_queue.cc:260] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.406701 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 8535ad2fe942494bbd892e639d8882c4 (DEFAULT_TABLE table=default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.410451 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8535ad2fe942494bbd892e639d8882c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.420753 28667 ts_tablet_manager.cc:1434] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260928 07:56:05.424502 27823 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:05.431463 28667 tablet_bootstrap.cc:492] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:05.436954 28658 ts_tablet_manager.cc:1929] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.437500 28658 log.cc:1199] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/ca01956e0d5141438038dc3f9110cc64
I20260928 07:56:05.438278 28658 ts_tablet_manager.cc:1950] T ca01956e0d5141438038dc3f9110cc64 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:05.441051 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet ca01956e0d5141438038dc3f9110cc64 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:05.444357 28667 tablet_bootstrap.cc:654] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.447098 28662 tablet_bootstrap.cc:492] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:05.447536 28662 ts_tablet_manager.cc:1403] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.111s user 0.012s sys 0.003s
I20260928 07:56:05.448390 27823 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:05.450279 28662 raft_consensus.cc:359] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.450728 28666 tablet_bootstrap.cc:492] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:05.450909 28662 raft_consensus.cc:385] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.451176 28662 raft_consensus.cc:740] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.456442 28662 consensus_queue.cc:260] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.457818 28656 ts_tablet_manager.cc:1929] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.458163 28656 log.cc:1199] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/ca01956e0d5141438038dc3f9110cc64
I20260928 07:56:05.460867 28662 ts_tablet_manager.cc:1434] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.013s user 0.006s sys 0.001s
I20260928 07:56:05.461174 28656 ts_tablet_manager.cc:1950] T ca01956e0d5141438038dc3f9110cc64 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:05.464214 28667 tablet_bootstrap.cc:492] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:05.464617 28667 ts_tablet_manager.cc:1403] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.000s
I20260928 07:56:05.467005 28667 raft_consensus.cc:359] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.467633 28667 raft_consensus.cc:385] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.467887 28667 raft_consensus.cc:740] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.468515 28667 consensus_queue.cc:260] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.472199 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 with delete_type TABLET_DATA_DELETED (replaced by tablet c67222a9df344ae48b94ea5e970fd9a8) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:05.473641 28656 tablet_replica.cc:333] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:05.473987 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet ca01956e0d5141438038dc3f9110cc64 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:05.474220 28656 raft_consensus.cc:2243] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.474614 28656 raft_consensus.cc:2272] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.475558 28662 tablet_bootstrap.cc:492] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:05.483068 28656 ts_tablet_manager.cc:1916] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.487856 28773 raft_consensus.cc:493] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:05.488296 28773 raft_consensus.cc:515] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.490182 28773 leader_election.cc:290] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:05.490223 27823 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:05.492645 28667 ts_tablet_manager.cc:1434] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.028s user 0.004s sys 0.002s
I20260928 07:56:05.492476 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14ce2207154262a8a6b4d7b7e1e137" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:05.493880 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14ce2207154262a8a6b4d7b7e1e137" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:05.495366 28285 leader_election.cc:343] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:05.496520 28286 leader_election.cc:343] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:05.496913 28286 leader_election.cc:304] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:05.498010 28773 raft_consensus.cc:2749] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:05.499595 28773 raft_consensus.cc:493] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:05.499984 28773 raft_consensus.cc:515] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.501955 28662 tablet_bootstrap.cc:654] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.501899 28773 leader_election.cc:290] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:05.504659 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3aad1a314d4cc39b9b2e42a3022944" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:05.506210 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3aad1a314d4cc39b9b2e42a3022944" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:05.507730 28285 leader_election.cc:343] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:05.508400 28666 tablet_bootstrap.cc:654] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:05.508507 28286 leader_election.cc:343] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:05.508893 28286 leader_election.cc:304] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:05.510145 28773 raft_consensus.cc:2749] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 07:56:05.511641 27823 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8535ad2fe942494bbd892e639d8882c4 consensus state has no leader
I20260928 07:56:05.519461 28656 ts_tablet_manager.cc:1929] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.519835 28656 log.cc:1199] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/b55b0d19a14d42b5b02e4fcd3e6499c2
I20260928 07:56:05.520454 28656 ts_tablet_manager.cc:1950] T b55b0d19a14d42b5b02e4fcd3e6499c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:05.521135 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet b55b0d19a14d42b5b02e4fcd3e6499c2 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:05.525460 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet b55b0d19a14d42b5b02e4fcd3e6499c2 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:05.530551 27824 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 1 got 0
I20260928 07:56:05.538035 28662 tablet_bootstrap.cc:492] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:05.538470 28662 ts_tablet_manager.cc:1403] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.012s
I20260928 07:56:05.546895 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet c67222a9df344ae48b94ea5e970fd9a8 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:05.548513 27825 catalog_manager.cc:2213] created HMS catalog entry for table [id=32c6fc06bd3943feafb83880480a76c2]
I20260928 07:56:05.557581 28662 raft_consensus.cc:359] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.558234 28662 raft_consensus.cc:385] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.558506 28662 raft_consensus.cc:740] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.562180 28662 consensus_queue.cc:260] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.572275 27823 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet c67222a9df344ae48b94ea5e970fd9a8
I20260928 07:56:05.575006 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d54228bdf584a59a7a9ff4aab071c09) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:05.577082 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d54228bdf584a59a7a9ff4aab071c09) from {username='slave'} at 127.0.0.1:60428
W20260928 07:56:05.577000 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet c67222a9df344ae48b94ea5e970fd9a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c67222a9df344ae48b94ea5e970fd9a8 already in progress: creating tablet
I20260928 07:56:05.577747 28662 ts_tablet_manager.cc:1434] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.039s user 0.008s sys 0.000s
I20260928 07:56:05.578536 28657 tablet_replica.cc:333] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:05.579274 28657 raft_consensus.cc:2243] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.579726 28657 raft_consensus.cc:2272] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.581449 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d54228bdf584a59a7a9ff4aab071c09) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:05.577991 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:04 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:05.582577 27823 catalog_manager.cc:6934] ReplaceTablet: tablet c67222a9df344ae48b94ea5e970fd9a8 deleted and replaced by tablet 6d54228bdf584a59a7a9ff4aab071c09
I20260928 07:56:05.584934 28656 tablet_replica.cc:333] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:05.585549 28656 raft_consensus.cc:2243] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.585975 28656 raft_consensus.cc:2272] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:05.587076 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet c67222a9df344ae48b94ea5e970fd9a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c67222a9df344ae48b94ea5e970fd9a8 already in progress: creating tablet
I20260928 07:56:05.591696 28656 ts_tablet_manager.cc:1916] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.594228 28657 ts_tablet_manager.cc:1916] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.620532 27825 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 36) took 2324 ms. Trace:
I20260928 07:56:05.625285 28666 tablet_bootstrap.cc:492] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:05.625737 28666 ts_tablet_manager.cc:1403] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.175s user 0.013s sys 0.007s
I20260928 07:56:05.628330 28666 raft_consensus.cc:359] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.630937 28656 ts_tablet_manager.cc:1929] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.631362 28656 log.cc:1199] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/242aa5fc7f7745b6905cbd0cc70e0b7a
I20260928 07:56:05.621477 27825 rpcz_store.cc:276] 0928 07:56:03.296229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:03.296368 (+ 139us) service_pool.cc:224] Handling call
0928 07:56:05.102453 (+1806085us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:05.104219 (+ 1766us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:05.548471 (+444252us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:05.619777 (+ 71306us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:05.620130 (+ 353us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:05.620461 (+ 331us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:05.587491 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:05.587904 (+ 413us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:05.587930 (+ 26us) write_op.cc:435] Acquired schema lock
0928 07:56:05.587943 (+ 13us) tablet.cc:662] Decoding operations
0928 07:56:05.588220 (+ 277us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:05.588261 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:05.588283 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:05.588482 (+ 199us) tablet.cc:701] Row locks acquired
0928 07:56:05.588496 (+ 14us) write_op.cc:260] PREPARE: finished
0928 07:56:05.588616 (+ 120us) write_op.cc:270] Start()
0928 07:56:05.588701 (+ 85us) write_op.cc:276] Timestamp: P: 1790582165588555 usec, L: 0
0928 07:56:05.588715 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 07:56:05.589237 (+ 522us) log.cc:844] Serialized 432 byte log entry
0928 07:56:05.617462 (+ 28225us) op_driver.cc:464] REPLICATION: finished
0928 07:56:05.617916 (+ 454us) write_op.cc:301] APPLY: starting
0928 07:56:05.617969 (+ 53us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:05.618075 (+ 106us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:05.618158 (+ 83us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:05.618582 (+ 424us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:05.618739 (+ 157us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:05.618783 (+ 44us) write_op.cc:312] APPLY: finished
0928 07:56:05.619057 (+ 274us) log.cc:844] Serialized 28 byte log entry
0928 07:56:05.619229 (+ 172us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:05.619311 (+ 82us) write_op.cc:454] Released schema lock
0928 07:56:05.619350 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":196822,"Hive Metastore.run_cpu_time_us":699,"Hive Metastore.run_wall_time_us":245086,"spinlock_wait_cycles":43776,"child_traces":[["op",{"apply.queue_time_us":286,"apply.run_cpu_time_us":1561,"apply.run_wall_time_us":1626,"mutex_wait_us":19159,"num_ops":2,"prepare.queue_time_us":37272,"prepare.run_cpu_time_us":2049,"prepare.run_wall_time_us":2210,"raft.queue_time_us":91,"raft.run_cpu_time_us":17,"raft.run_wall_time_us":17,"replication_time_us":28658}]]}
I20260928 07:56:05.633019 28656 ts_tablet_manager.cc:1950] T 242aa5fc7f7745b6905cbd0cc70e0b7a P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:05.635015 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 242aa5fc7f7745b6905cbd0cc70e0b7a (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:05.641809 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.642853 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d54228bdf584a59a7a9ff4aab071c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.644193 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.629076 28666 raft_consensus.cc:385] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.645258 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d54228bdf584a59a7a9ff4aab071c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.645440 28666 raft_consensus.cc:740] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.647358 28666 consensus_queue.cc:260] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.647939 28662 tablet_bootstrap.cc:492] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:05.650657 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.651778 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d54228bdf584a59a7a9ff4aab071c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.662374 28666 ts_tablet_manager.cc:1434] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.036s user 0.005s sys 0.001s
I20260928 07:56:05.671389 28662 tablet_bootstrap.cc:654] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.672139 28657 ts_tablet_manager.cc:1929] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.672514 28657 log.cc:1199] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/c67222a9df344ae48b94ea5e970fd9a8
I20260928 07:56:05.673185 28657 ts_tablet_manager.cc:1950] T c67222a9df344ae48b94ea5e970fd9a8 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:05.675733 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet c67222a9df344ae48b94ea5e970fd9a8 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:05.677857 28666 tablet_bootstrap.cc:492] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:05.687680 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet b55b0d19a14d42b5b02e4fcd3e6499c2 with delete_type TABLET_DATA_DELETED (replaced by tablet c67222a9df344ae48b94ea5e970fd9a8) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:05.693917 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 4d73e199db0a4d93b60a36df144dc58f (DEFAULT_TABLE table=default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.695135 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d73e199db0a4d93b60a36df144dc58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.696521 28667 tablet_bootstrap.cc:492] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:05.702675 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 4d73e199db0a4d93b60a36df144dc58f (DEFAULT_TABLE table=default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.702896 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 4d73e199db0a4d93b60a36df144dc58f (DEFAULT_TABLE table=default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.703212 28667 tablet_bootstrap.cc:654] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.703737 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d73e199db0a4d93b60a36df144dc58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.703984 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d73e199db0a4d93b60a36df144dc58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.706885 27820 catalog_manager.cc:2213] created HMS catalog entry for table [id=34b3a93d8c664dd781fd1315e4a838f3]
I20260928 07:56:05.711112 28658 tablet_replica.cc:333] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:05.711915 28658 raft_consensus.cc:2243] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.712635 28658 raft_consensus.cc:2272] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.721074 28658 ts_tablet_manager.cc:1916] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.728611 28666 tablet_bootstrap.cc:654] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.736513 27825 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a68cdf4fe824e36ab54acd3dc62ad38 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:05.737504 27820 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 47) took 1153 ms. Trace:
I20260928 07:56:05.736243 28658 ts_tablet_manager.cc:1929] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.747483 28658 log.cc:1199] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/b55b0d19a14d42b5b02e4fcd3e6499c2
I20260928 07:56:05.748165 28658 ts_tablet_manager.cc:1950] T b55b0d19a14d42b5b02e4fcd3e6499c2 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:05.750975 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet b55b0d19a14d42b5b02e4fcd3e6499c2 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:05.737845 27820 rpcz_store.cc:276] 0928 07:56:04.583702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:04.583820 (+ 118us) service_pool.cc:224] Handling call
0928 07:56:05.109665 (+525845us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:05.114273 (+ 4608us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:05.706835 (+592562us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:05.725072 (+ 18237us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:05.737076 (+ 12004us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:05.737434 (+ 358us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:05.708682 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:05.709082 (+ 400us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:05.709103 (+ 21us) write_op.cc:435] Acquired schema lock
0928 07:56:05.709115 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:05.709419 (+ 304us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:05.709456 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:05.709475 (+ 19us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:05.709657 (+ 182us) tablet.cc:701] Row locks acquired
0928 07:56:05.709670 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:05.709776 (+ 106us) write_op.cc:270] Start()
0928 07:56:05.709866 (+ 90us) write_op.cc:276] Timestamp: P: 1790582165709705 usec, L: 0
0928 07:56:05.709879 (+ 13us) op_driver.cc:348] REPLICATION: starting
0928 07:56:05.710365 (+ 486us) log.cc:844] Serialized 432 byte log entry
0928 07:56:05.721338 (+ 10973us) op_driver.cc:464] REPLICATION: finished
0928 07:56:05.721769 (+ 431us) write_op.cc:301] APPLY: starting
0928 07:56:05.721832 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:05.721938 (+ 106us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:05.722036 (+ 98us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:05.722422 (+ 386us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:05.722567 (+ 145us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:05.722609 (+ 42us) write_op.cc:312] APPLY: finished
0928 07:56:05.722806 (+ 197us) log.cc:844] Serialized 28 byte log entry
0928 07:56:05.722956 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:05.723027 (+ 71us) write_op.cc:454] Released schema lock
0928 07:56:05.723057 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:05.723275 (+ 218us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:05.723297 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":431939,"Hive Metastore.run_cpu_time_us":640,"Hive Metastore.run_wall_time_us":159303,"child_traces":[["op",{"apply.queue_time_us":278,"apply.run_cpu_time_us":1475,"apply.run_wall_time_us":1474,"num_ops":2,"prepare.queue_time_us":156,"prepare.run_cpu_time_us":1998,"prepare.run_wall_time_us":1999,"raft.queue_time_us":2594,"raft.run_cpu_time_us":703,"raft.run_wall_time_us":699,"replication_time_us":11327}]]}
I20260928 07:56:05.763551 28667 tablet_bootstrap.cc:492] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:05.763967 28667 ts_tablet_manager.cc:1403] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.068s user 0.016s sys 0.003s
I20260928 07:56:05.772141 28187 tablet_service.cc:1511] Processing CreateTablet for tablet e7aff6b3ddcb44089c0c1f938ed457b5 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.773537 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7aff6b3ddcb44089c0c1f938ed457b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.776647 28667 raft_consensus.cc:359] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.777339 28667 raft_consensus.cc:385] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.777621 28667 raft_consensus.cc:740] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.778260 28667 consensus_queue.cc:260] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.780552 28666 tablet_bootstrap.cc:492] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:05.781039 28666 ts_tablet_manager.cc:1403] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.105s user 0.008s sys 0.001s
I20260928 07:56:05.782477 28477 tablet_service.cc:1511] Processing CreateTablet for tablet e7aff6b3ddcb44089c0c1f938ed457b5 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.783692 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7aff6b3ddcb44089c0c1f938ed457b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.783784 28666 raft_consensus.cc:359] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.784456 28666 raft_consensus.cc:385] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.784711 28666 raft_consensus.cc:740] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.789742 28667 ts_tablet_manager.cc:1434] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20260928 07:56:05.803691 28773 raft_consensus.cc:493] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:05.804175 28773 raft_consensus.cc:515] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.806326 28773 leader_election.cc:290] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:05.808377 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535ad2fe942494bbd892e639d8882c4" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:05.808470 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535ad2fe942494bbd892e639d8882c4" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:05.810053 28285 leader_election.cc:343] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:05.810763 28286 leader_election.cc:343] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:05.811169 28286 leader_election.cc:304] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:05.812834 28773 raft_consensus.cc:2749] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:05.814608 28662 tablet_bootstrap.cc:492] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:05.815033 28662 ts_tablet_manager.cc:1403] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.167s user 0.019s sys 0.005s
I20260928 07:56:05.817181 28667 tablet_bootstrap.cc:492] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:05.817535 28662 raft_consensus.cc:359] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.818135 28662 raft_consensus.cc:385] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.818397 28662 raft_consensus.cc:740] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.819132 28662 consensus_queue.cc:260] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.821255 28666 consensus_queue.cc:260] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.826748 28330 tablet_service.cc:1511] Processing CreateTablet for tablet e7aff6b3ddcb44089c0c1f938ed457b5 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.827859 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7aff6b3ddcb44089c0c1f938ed457b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.830201 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944) from {username='slave'} at 127.0.0.1:54230
W20260928 07:56:05.834657 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a68cdf4fe824e36ab54acd3dc62ad38 already in progress: creating tablet
I20260928 07:56:05.834617 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 01999d17e6c94da586343fc9daa5a59f from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:05.837805 27825 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_33b6d1f71f5b44d0aec9c0f698e7d014"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:05.843219 28667 tablet_bootstrap.cc:654] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.843268 28666 ts_tablet_manager.cc:1434] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.062s user 0.004s sys 0.002s
I20260928 07:56:05.848922 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 242aa5fc7f7745b6905cbd0cc70e0b7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:04 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:05.849687 28658 tablet_replica.cc:333] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:05.850291 28658 raft_consensus.cc:2243] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.850739 28658 raft_consensus.cc:2272] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.852119 28662 ts_tablet_manager.cc:1434] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.037s user 0.006s sys 0.001s
I20260928 07:56:05.854383 28666 tablet_bootstrap.cc:492] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:05.855260 28658 ts_tablet_manager.cc:1916] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.869356 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 01999d17e6c94da586343fc9daa5a59f
I20260928 07:56:05.871304 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 01999d17e6c94da586343fc9daa5a59f with delete_type TABLET_DATA_DELETED (replaced by tablet 1e0e52acb3084a78b0a50a6013d7a984) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:05.872534 28662 tablet_bootstrap.cc:492] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:05.872473 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 01999d17e6c94da586343fc9daa5a59f with delete_type TABLET_DATA_DELETED (replaced by tablet 1e0e52acb3084a78b0a50a6013d7a984) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:05.873018 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 01999d17e6c94da586343fc9daa5a59f with delete_type TABLET_DATA_DELETED (replaced by tablet 1e0e52acb3084a78b0a50a6013d7a984) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:05.873703 28657 tablet_replica.cc:333] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:05.874392 28657 raft_consensus.cc:2243] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.874868 28657 raft_consensus.cc:2272] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.876578 28657 ts_tablet_manager.cc:1916] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.879298 28667 tablet_bootstrap.cc:492] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:05.879742 28667 ts_tablet_manager.cc:1403] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.063s user 0.008s sys 0.002s
I20260928 07:56:05.882481 28667 raft_consensus.cc:359] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.883251 28667 raft_consensus.cc:385] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.883337 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 01999d17e6c94da586343fc9daa5a59f deleted and replaced by tablet 1e0e52acb3084a78b0a50a6013d7a984
I20260928 07:56:05.883489 28667 raft_consensus.cc:740] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.893478 28667 consensus_queue.cc:260] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.897886 28666 tablet_bootstrap.cc:654] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.911657 28662 tablet_bootstrap.cc:654] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.914520 28667 ts_tablet_manager.cc:1434] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.034s user 0.001s sys 0.006s
I20260928 07:56:05.920866 28667 tablet_bootstrap.cc:492] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:05.922715 28658 ts_tablet_manager.cc:1929] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:05.923195 28658 log.cc:1199] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/242aa5fc7f7745b6905cbd0cc70e0b7a
I20260928 07:56:05.923988 28658 ts_tablet_manager.cc:1950] T 242aa5fc7f7745b6905cbd0cc70e0b7a P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:05.928053 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0e52acb3084a78b0a50a6013d7a984 (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.937137 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0e52acb3084a78b0a50a6013d7a984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.942360 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:05.950673 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0e52acb3084a78b0a50a6013d7a984 (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.951097 28656 tablet_replica.cc:333] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:05.951681 28656 raft_consensus.cc:2243] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:05.951771 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0e52acb3084a78b0a50a6013d7a984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.952108 28656 raft_consensus.cc:2272] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:05.952675 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 242aa5fc7f7745b6905cbd0cc70e0b7a (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4]) successfully deleted
I20260928 07:56:05.931531 28666 tablet_bootstrap.cc:492] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
W20260928 07:56:05.953471 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 01999d17e6c94da586343fc9daa5a59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01999d17e6c94da586343fc9daa5a59f already in progress: creating tablet
I20260928 07:56:05.953608 28666 ts_tablet_manager.cc:1403] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.099s user 0.010s sys 0.001s
I20260928 07:56:05.955468 28656 ts_tablet_manager.cc:1916] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:05.957211 28666 raft_consensus.cc:359] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.957828 28666 raft_consensus.cc:385] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.957983 28662 tablet_bootstrap.cc:492] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:05.958076 28666 raft_consensus.cc:740] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.958529 28667 tablet_bootstrap.cc:654] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:05.958627 28662 ts_tablet_manager.cc:1403] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.086s user 0.008s sys 0.003s
I20260928 07:56:05.961241 28662 raft_consensus.cc:359] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.964424 27822 catalog_manager.cc:2213] created HMS catalog entry for table [id=5ede51d78549417b8bfc039f2d7c87f6]
W20260928 07:56:05.964840 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 01999d17e6c94da586343fc9daa5a59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01999d17e6c94da586343fc9daa5a59f already in progress: creating tablet
I20260928 07:56:05.964784 28666 consensus_queue.cc:260] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:05.965586 28662 raft_consensus.cc:385] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.949921 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0e52acb3084a78b0a50a6013d7a984 (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:05.968946 28773 raft_consensus.cc:493] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:05.967984 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0e52acb3084a78b0a50a6013d7a984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:05.969532 28773 raft_consensus.cc:515] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.971658 28773 leader_election.cc:290] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:05.965899 28662 raft_consensus.cc:740] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:05.973567 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d54228bdf584a59a7a9ff4aab071c09" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:05.973415 28662 consensus_queue.cc:260] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:05.976290 28286 leader_election.cc:343] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:05.978003 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d54228bdf584a59a7a9ff4aab071c09" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:05.981943 28285 leader_election.cc:343] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:05.982363 28285 leader_election.cc:304] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:05.983076 28773 raft_consensus.cc:2749] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:05.989547 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:05.991523 28667 tablet_bootstrap.cc:492] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:05.992092 28667 ts_tablet_manager.cc:1403] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.071s user 0.008s sys 0.000s
I20260928 07:56:05.992242 27822 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 40) took 2233 ms. Trace:
I20260928 07:56:05.993285 27820 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_66df2d021af141bf9af764fb609f0941"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:05.995074 28667 raft_consensus.cc:359] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:05.995838 28667 raft_consensus.cc:385] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:05.996125 28667 raft_consensus.cc:740] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
W20260928 07:56:05.998343 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a68cdf4fe824e36ab54acd3dc62ad38 already in progress: creating tablet
I20260928 07:56:05.999209 28666 ts_tablet_manager.cc:1434] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.045s user 0.005s sys 0.000s
I20260928 07:56:06.000051 28662 ts_tablet_manager.cc:1434] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260928 07:56:05.992549 27822 rpcz_store.cc:276] 0928 07:56:03.758409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:03.759516 (+ 1107us) service_pool.cc:224] Handling call
0928 07:56:05.107659 (+1348143us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:05.114945 (+ 7286us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:05.964382 (+849437us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:05.991630 (+ 27248us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:05.991927 (+ 297us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:05.992180 (+ 253us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:05.966268 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:05.966671 (+ 403us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:05.966695 (+ 24us) write_op.cc:435] Acquired schema lock
0928 07:56:05.966707 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:05.967014 (+ 307us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:05.967053 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:05.967074 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:05.967277 (+ 203us) tablet.cc:701] Row locks acquired
0928 07:56:05.967289 (+ 12us) write_op.cc:260] PREPARE: finished
0928 07:56:05.967402 (+ 113us) write_op.cc:270] Start()
0928 07:56:05.967483 (+ 81us) write_op.cc:276] Timestamp: P: 1790582165967364 usec, L: 0
0928 07:56:05.967498 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:05.967944 (+ 446us) log.cc:844] Serialized 432 byte log entry
0928 07:56:05.986814 (+ 18870us) op_driver.cc:464] REPLICATION: finished
0928 07:56:05.988037 (+ 1223us) write_op.cc:301] APPLY: starting
0928 07:56:05.988109 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:05.988247 (+ 138us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:05.988346 (+ 99us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:05.988784 (+ 438us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:05.988935 (+ 151us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:05.988983 (+ 48us) write_op.cc:312] APPLY: finished
0928 07:56:05.989186 (+ 203us) log.cc:844] Serialized 28 byte log entry
0928 07:56:05.991134 (+ 1948us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:05.991217 (+ 83us) write_op.cc:454] Released schema lock
0928 07:56:05.991261 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:05.991503 (+ 242us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:05.991529 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":590812,"Hive Metastore.run_cpu_time_us":636,"Hive Metastore.run_wall_time_us":257468,"spinlock_wait_cycles":24576,"child_traces":[["op",{"apply.queue_time_us":1006,"apply.run_cpu_time_us":1709,"apply.run_wall_time_us":3435,"num_ops":2,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2008,"prepare.run_wall_time_us":2009,"raft.queue_time_us":546,"raft.run_cpu_time_us":734,"raft.run_wall_time_us":734,"replication_time_us":19186}]]}
I20260928 07:56:06.001384 28667 consensus_queue.cc:260] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.008965 28773 raft_consensus.cc:493] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:06.009510 28773 raft_consensus.cc:515] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.010372 28662 tablet_bootstrap.cc:492] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:06.011332 28773 leader_election.cc:290] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:06.012601 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aff6b3ddcb44089c0c1f938ed457b5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:06.014227 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aff6b3ddcb44089c0c1f938ed457b5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:06.015146 28285 leader_election.cc:343] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:06.015831 28286 leader_election.cc:343] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:06.016238 28286 leader_election.cc:304] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:06.017740 28773 raft_consensus.cc:2749] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:06.023219 28667 ts_tablet_manager.cc:1434] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.031s user 0.009s sys 0.000s
I20260928 07:56:06.023317 28662 tablet_bootstrap.cc:654] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.024868 28666 tablet_bootstrap.cc:492] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:06.026991 28667 tablet_bootstrap.cc:492] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:06.028987 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a68cdf4fe824e36ab54acd3dc62ad38 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d3aad1a314d4cc39b9b2e42a3022944) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:06.029688 28658 tablet_replica.cc:333] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:06.035076 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 49817bcae6d340d19817a14cf8cc0f98 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:06.038226 28657 ts_tablet_manager.cc:1929] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.054544 28658 raft_consensus.cc:2243] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.055063 28658 raft_consensus.cc:2272] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.062446 28658 ts_tablet_manager.cc:1916] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.080499 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 49817bcae6d340d19817a14cf8cc0f98
I20260928 07:56:06.082435 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 49817bcae6d340d19817a14cf8cc0f98 with delete_type TABLET_DATA_DELETED (replaced by tablet a97ca287aa0e4ffcb387cc1c144a5a31) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:06.084405 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 49817bcae6d340d19817a14cf8cc0f98 with delete_type TABLET_DATA_DELETED (replaced by tablet a97ca287aa0e4ffcb387cc1c144a5a31) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:06.085057 27824 catalog_manager.cc:6934] ReplaceTablet: tablet 49817bcae6d340d19817a14cf8cc0f98 deleted and replaced by tablet a97ca287aa0e4ffcb387cc1c144a5a31
I20260928 07:56:06.095335 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet c67222a9df344ae48b94ea5e970fd9a8 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:06.095741 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 69d6c21b845649ac81e0b98eacaf6fff (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.097733 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6c21b845649ac81e0b98eacaf6fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.102416 28666 tablet_bootstrap.cc:654] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.104911 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 69d6c21b845649ac81e0b98eacaf6fff (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.106419 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6c21b845649ac81e0b98eacaf6fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.129293 27821 catalog_manager.cc:2213] created HMS catalog entry for table [id=659e362fe6584f90b283788d579b9321]
I20260928 07:56:06.042063 28667 tablet_bootstrap.cc:654] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.135710 28657 log.cc:1199] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/01999d17e6c94da586343fc9daa5a59f
I20260928 07:56:06.136638 28657 ts_tablet_manager.cc:1950] T 01999d17e6c94da586343fc9daa5a59f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:06.083472 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 49817bcae6d340d19817a14cf8cc0f98 with delete_type TABLET_DATA_DELETED (replaced by tablet a97ca287aa0e4ffcb387cc1c144a5a31) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:06.124670 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 69d6c21b845649ac81e0b98eacaf6fff (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.138722 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6c21b845649ac81e0b98eacaf6fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.140041 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 01999d17e6c94da586343fc9daa5a59f (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:06.140862 28657 tablet_replica.cc:333] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:06.141568 28657 raft_consensus.cc:2243] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.147698 27821 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 43) took 2098 ms. Trace:
I20260928 07:56:06.148048 27821 rpcz_store.cc:276] 0928 07:56:04.049632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:04.050328 (+ 696us) service_pool.cc:224] Handling call
0928 07:56:05.107868 (+1057540us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:05.111209 (+ 3341us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:06.129246 (+1018037us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:06.147007 (+ 17761us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:06.147362 (+ 355us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:06.147632 (+ 270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:06.131309 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:06.131986 (+ 677us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:06.132027 (+ 41us) write_op.cc:435] Acquired schema lock
0928 07:56:06.132050 (+ 23us) tablet.cc:662] Decoding operations
0928 07:56:06.132458 (+ 408us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:06.132524 (+ 66us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:06.132562 (+ 38us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:06.132876 (+ 314us) tablet.cc:701] Row locks acquired
0928 07:56:06.132898 (+ 22us) write_op.cc:260] PREPARE: finished
0928 07:56:06.133059 (+ 161us) write_op.cc:270] Start()
0928 07:56:06.133181 (+ 122us) write_op.cc:276] Timestamp: P: 1790582166132985 usec, L: 0
0928 07:56:06.133206 (+ 25us) op_driver.cc:348] REPLICATION: starting
0928 07:56:06.133758 (+ 552us) log.cc:844] Serialized 432 byte log entry
0928 07:56:06.144819 (+ 11061us) op_driver.cc:464] REPLICATION: finished
0928 07:56:06.145330 (+ 511us) write_op.cc:301] APPLY: starting
0928 07:56:06.145386 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:06.145499 (+ 113us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:06.145594 (+ 95us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:06.145997 (+ 403us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:06.146139 (+ 142us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:06.146177 (+ 38us) write_op.cc:312] APPLY: finished
0928 07:56:06.146385 (+ 208us) log.cc:844] Serialized 28 byte log entry
0928 07:56:06.146543 (+ 158us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:06.146617 (+ 74us) write_op.cc:454] Released schema lock
0928 07:56:06.146647 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":848226,"Hive Metastore.run_cpu_time_us":647,"Hive Metastore.run_wall_time_us":164962,"spinlock_wait_cycles":66432,"child_traces":[["op",{"apply.queue_time_us":307,"apply.run_cpu_time_us":1526,"apply.run_wall_time_us":1527,"mutex_wait_us":163,"num_ops":2,"prepare.queue_time_us":271,"raft.queue_time_us":362,"raft.run_cpu_time_us":842,"raft.run_wall_time_us":843,"replication_time_us":11483}]]}
I20260928 07:56:06.150978 28666 tablet_bootstrap.cc:492] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:06.151425 28666 ts_tablet_manager.cc:1403] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.127s user 0.010s sys 0.000s
I20260928 07:56:06.155993 28666 raft_consensus.cc:359] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.163966 28666 raft_consensus.cc:385] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.165146 28666 raft_consensus.cc:740] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.167639 28666 consensus_queue.cc:260] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.173014 28666 ts_tablet_manager.cc:1434] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20260928 07:56:06.178215 28656 ts_tablet_manager.cc:1929] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.178609 28656 log.cc:1199] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/0a68cdf4fe824e36ab54acd3dc62ad38
I20260928 07:56:06.179299 28656 ts_tablet_manager.cc:1950] T 0a68cdf4fe824e36ab54acd3dc62ad38 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:06.181823 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 0a68cdf4fe824e36ab54acd3dc62ad38 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:06.159379 28658 ts_tablet_manager.cc:1929] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.182837 28656 tablet_replica.cc:333] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:06.183022 28666 tablet_bootstrap.cc:492] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:06.183495 28656 raft_consensus.cc:2243] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.183974 28656 raft_consensus.cc:2272] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.185496 28657 raft_consensus.cc:2272] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.186110 28656 ts_tablet_manager.cc:1916] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.187822 28657 ts_tablet_manager.cc:1916] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.180517 28667 tablet_bootstrap.cc:492] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:06.189528 28667 ts_tablet_manager.cc:1403] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.163s user 0.015s sys 0.003s
W20260928 07:56:06.189841 27814 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_5554a4e3daa34b5bae576237453e3c77 [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8535ad2fe942494bbd892e639d8882c4 consensus state has no leader
I20260928 07:56:06.192040 28667 raft_consensus.cc:359] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.192636 28667 raft_consensus.cc:385] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.192867 28667 raft_consensus.cc:740] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.191875 28658 log.cc:1199] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/0a68cdf4fe824e36ab54acd3dc62ad38
I20260928 07:56:06.201928 28658 ts_tablet_manager.cc:1950] T 0a68cdf4fe824e36ab54acd3dc62ad38 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:06.201772 28667 consensus_queue.cc:260] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.207934 28662 tablet_bootstrap.cc:492] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:06.208431 28662 ts_tablet_manager.cc:1403] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.198s user 0.006s sys 0.045s
I20260928 07:56:06.209124 28658 tablet_replica.cc:333] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:06.211544 28662 raft_consensus.cc:359] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.212270 28662 raft_consensus.cc:385] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.212858 28658 raft_consensus.cc:2243] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.213479 28658 raft_consensus.cc:2272] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.214524 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 0a68cdf4fe824e36ab54acd3dc62ad38 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:06.212554 28662 raft_consensus.cc:740] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.217921 28662 consensus_queue.cc:260] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.218421 28667 ts_tablet_manager.cc:1434] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.029s user 0.006s sys 0.001s
I20260928 07:56:06.226857 27824 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_65e854322c2740fcb3feff80ea836959"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:06.228789 28662 ts_tablet_manager.cc:1434] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20260928 07:56:06.221151 28658 ts_tablet_manager.cc:1916] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.233886 28662 tablet_bootstrap.cc:492] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:06.241132 28184 tablet_service.cc:1511] Processing CreateTablet for tablet a97ca287aa0e4ffcb387cc1c144a5a31 (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.242405 28667 tablet_bootstrap.cc:492] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:06.246683 28666 tablet_bootstrap.cc:654] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.247399 28329 tablet_service.cc:1511] Processing CreateTablet for tablet a97ca287aa0e4ffcb387cc1c144a5a31 (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.252429 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97ca287aa0e4ffcb387cc1c144a5a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.244910 28477 tablet_service.cc:1511] Processing CreateTablet for tablet a97ca287aa0e4ffcb387cc1c144a5a31 (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.255455 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97ca287aa0e4ffcb387cc1c144a5a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.255759 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97ca287aa0e4ffcb387cc1c144a5a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.264065 28662 tablet_bootstrap.cc:654] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.277102 28667 tablet_bootstrap.cc:654] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.287300 28185 tablet_service.cc:1511] Processing CreateTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.288386 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2695ae64f6d4b5ab81fe9e234025ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.293635 28658 ts_tablet_manager.cc:1929] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.294071 28658 log.cc:1199] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/49817bcae6d340d19817a14cf8cc0f98
I20260928 07:56:06.294674 28658 ts_tablet_manager.cc:1950] T 49817bcae6d340d19817a14cf8cc0f98 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:06.295661 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 01999d17e6c94da586343fc9daa5a59f from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:06.297009 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 49817bcae6d340d19817a14cf8cc0f98 (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]) successfully deleted
I20260928 07:56:06.306537 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 0d3aad1a314d4cc39b9b2e42a3022944 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:06.318572 28479 tablet_service.cc:1511] Processing CreateTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.319675 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2695ae64f6d4b5ab81fe9e234025ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.331668 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 0d3aad1a314d4cc39b9b2e42a3022944
I20260928 07:56:06.334450 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d3aad1a314d4cc39b9b2e42a3022944 with delete_type TABLET_DATA_DELETED (replaced by tablet 7fa47d4f3bbb45f89a1750e512614b98) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:06.334805 28666 tablet_bootstrap.cc:492] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:06.335215 28666 ts_tablet_manager.cc:1403] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.152s user 0.009s sys 0.000s
I20260928 07:56:06.335208 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 0d3aad1a314d4cc39b9b2e42a3022944 deleted and replaced by tablet 7fa47d4f3bbb45f89a1750e512614b98
W20260928 07:56:06.336165 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 0d3aad1a314d4cc39b9b2e42a3022944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d3aad1a314d4cc39b9b2e42a3022944 already in progress: creating tablet
I20260928 07:56:06.336184 28330 tablet_service.cc:1511] Processing CreateTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.337248 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2695ae64f6d4b5ab81fe9e234025ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.338351 28666 raft_consensus.cc:359] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.338958 28666 raft_consensus.cc:385] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.339243 28666 raft_consensus.cc:740] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.340008 28666 consensus_queue.cc:260] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.341475 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d3aad1a314d4cc39b9b2e42a3022944 with delete_type TABLET_DATA_DELETED (replaced by tablet 7fa47d4f3bbb45f89a1750e512614b98) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:06.344400 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d3aad1a314d4cc39b9b2e42a3022944 with delete_type TABLET_DATA_DELETED (replaced by tablet 7fa47d4f3bbb45f89a1750e512614b98) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:06.348193 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d54228bdf584a59a7a9ff4aab071c09) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:06.349848 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet c67222a9df344ae48b94ea5e970fd9a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c67222a9df344ae48b94ea5e970fd9a8 already in progress: creating tablet
I20260928 07:56:06.350524 28666 ts_tablet_manager.cc:1434] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260928 07:56:06.356112 28662 tablet_bootstrap.cc:492] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:06.356638 28662 ts_tablet_manager.cc:1403] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.123s user 0.007s sys 0.003s
I20260928 07:56:06.359416 28662 raft_consensus.cc:359] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.360040 28662 raft_consensus.cc:385] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.360314 28662 raft_consensus.cc:740] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.361907 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d54228bdf584a59a7a9ff4aab071c09) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:06.362696 28658 tablet_replica.cc:333] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:06.363432 28658 raft_consensus.cc:2243] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.363920 28658 raft_consensus.cc:2272] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.366171 28658 ts_tablet_manager.cc:1916] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.356832 27821 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_0c6b380af93d44238ab04f5fce282fbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 07:56:06.372887 28092 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8535ad2fe942494bbd892e639d8882c4 consensus state has no leader
I20260928 07:56:06.372872 28662 consensus_queue.cc:260] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.373970 28666 tablet_bootstrap.cc:492] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:06.379391 28666 tablet_bootstrap.cc:654] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.381637 28662 ts_tablet_manager.cc:1434] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260928 07:56:06.382541 28662 tablet_bootstrap.cc:492] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:06.391070 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet c67222a9df344ae48b94ea5e970fd9a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d54228bdf584a59a7a9ff4aab071c09) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:06.409590 28662 tablet_bootstrap.cc:654] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.414263 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa47d4f3bbb45f89a1750e512614b98 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.415268 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa47d4f3bbb45f89a1750e512614b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.417130 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa47d4f3bbb45f89a1750e512614b98 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.413949 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa47d4f3bbb45f89a1750e512614b98 (DEFAULT_TABLE table=default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.422111 27826 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 18) took 5992 ms. Trace:
I20260928 07:56:06.422960 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa47d4f3bbb45f89a1750e512614b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.422462 27826 rpcz_store.cc:276] 0928 07:56:00.429844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:00.429968 (+ 124us) service_pool.cc:224] Handling call
0928 07:56:05.099415 (+4669447us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:06.420099 (+1320684us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:06.421080 (+ 981us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:06.422040 (+ 960us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":78,"Hive Metastore.run_cpu_time_us":1820,"Hive Metastore.run_wall_time_us":200885}
I20260928 07:56:06.424820 28658 ts_tablet_manager.cc:1929] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.425309 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa47d4f3bbb45f89a1750e512614b98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:06.430346 27821 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0c6b380af93d44238ab04f5fce282fbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:56:06.431808 27825 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_33b6d1f71f5b44d0aec9c0f698e7d014 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:06.421691 28656 ts_tablet_manager.cc:1929] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.433248 28656 log.cc:1199] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/49817bcae6d340d19817a14cf8cc0f98
W20260928 07:56:06.433691 27820 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_66df2d021af141bf9af764fb609f0941 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:06.433954 28656 ts_tablet_manager.cc:1950] T 49817bcae6d340d19817a14cf8cc0f98 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
W20260928 07:56:06.436487 27824 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_65e854322c2740fcb3feff80ea836959 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:06.436585 28667 tablet_bootstrap.cc:492] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:06.453795 28667 ts_tablet_manager.cc:1403] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.212s user 0.012s sys 0.007s
I20260928 07:56:06.456269 28667 raft_consensus.cc:359] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.457643 28657 ts_tablet_manager.cc:1929] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.457995 28657 log.cc:1199] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/49817bcae6d340d19817a14cf8cc0f98
I20260928 07:56:06.458647 28657 ts_tablet_manager.cc:1950] T 49817bcae6d340d19817a14cf8cc0f98 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:06.461511 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 49817bcae6d340d19817a14cf8cc0f98 (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]) successfully deleted
I20260928 07:56:06.462565 28656 tablet_replica.cc:333] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:06.463320 28656 raft_consensus.cc:2243] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.463812 28656 raft_consensus.cc:2272] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.466050 28656 ts_tablet_manager.cc:1916] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.466765 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 49817bcae6d340d19817a14cf8cc0f98 (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]) successfully deleted
I20260928 07:56:06.456893 28667 raft_consensus.cc:385] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.469260 28658 log.cc:1199] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/c67222a9df344ae48b94ea5e970fd9a8
I20260928 07:56:06.469561 28667 raft_consensus.cc:740] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.470294 28658 ts_tablet_manager.cc:1950] T c67222a9df344ae48b94ea5e970fd9a8 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:06.470676 28657 tablet_replica.cc:333] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:06.471428 28657 raft_consensus.cc:2243] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.471889 28657 raft_consensus.cc:2272] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.473531 28666 tablet_bootstrap.cc:492] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:06.473618 28657 ts_tablet_manager.cc:1916] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.473955 28666 ts_tablet_manager.cc:1403] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.118s user 0.009s sys 0.000s
I20260928 07:56:06.475482 28667 consensus_queue.cc:260] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.476400 28666 raft_consensus.cc:359] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.476985 28666 raft_consensus.cc:385] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.485703 28666 raft_consensus.cc:740] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.486616 28666 consensus_queue.cc:260] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.488348 28667 ts_tablet_manager.cc:1434] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.034s user 0.004s sys 0.001s
I20260928 07:56:06.493818 28662 tablet_bootstrap.cc:492] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:06.494313 28662 ts_tablet_manager.cc:1403] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.112s user 0.012s sys 0.004s
I20260928 07:56:06.496747 28662 raft_consensus.cc:359] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.498095 28666 ts_tablet_manager.cc:1434] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.024s user 0.006s sys 0.001s
I20260928 07:56:06.501578 28662 raft_consensus.cc:385] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.502013 28666 tablet_bootstrap.cc:492] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:06.501937 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d3aad1a314d4cc39b9b2e42a3022944 with delete_type TABLET_DATA_DELETED (replaced by tablet 7fa47d4f3bbb45f89a1750e512614b98) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:06.505606 28662 raft_consensus.cc:740] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.507225 28662 consensus_queue.cc:260] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.513890 27823 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:06.514873 28658 tablet_replica.cc:333] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:06.515451 28658 raft_consensus.cc:2243] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.515862 28658 raft_consensus.cc:2272] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.516834 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet c67222a9df344ae48b94ea5e970fd9a8 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:06.517987 28662 ts_tablet_manager.cc:1434] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.023s user 0.003s sys 0.002s
I20260928 07:56:06.518985 28658 ts_tablet_manager.cc:1916] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.520273 28666 tablet_bootstrap.cc:654] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.522544 28667 tablet_bootstrap.cc:492] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:06.524504 28662 tablet_bootstrap.cc:492] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:06.528247 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:06.534067 28656 ts_tablet_manager.cc:1929] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.536109 28656 log.cc:1199] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/0d3aad1a314d4cc39b9b2e42a3022944
I20260928 07:56:06.536836 28656 ts_tablet_manager.cc:1950] T 0d3aad1a314d4cc39b9b2e42a3022944 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:06.538302 28666 tablet_bootstrap.cc:492] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:06.535802 28662 tablet_bootstrap.cc:654] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.538724 28666 ts_tablet_manager.cc:1403] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.037s user 0.009s sys 0.000s
I20260928 07:56:06.541968 28656 tablet_replica.cc:333] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:06.542204 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 0d3aad1a314d4cc39b9b2e42a3022944 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:06.542726 28656 raft_consensus.cc:2243] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.545459 28656 raft_consensus.cc:2272] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.547713 28656 ts_tablet_manager.cc:1916] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.548206 28666 raft_consensus.cc:359] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.551075 28666 raft_consensus.cc:385] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.551332 28666 raft_consensus.cc:740] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.553503 28666 consensus_queue.cc:260] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.559386 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet b2695ae64f6d4b5ab81fe9e234025ca7 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:06.566156 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 01999d17e6c94da586343fc9daa5a59f with delete_type TABLET_DATA_DELETED (replaced by tablet 1e0e52acb3084a78b0a50a6013d7a984) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:06.565205 28666 ts_tablet_manager.cc:1434] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20260928 07:56:06.568120 27826 master_service.cc:960] ReplaceTablet: received request to replace tablet 6d54228bdf584a59a7a9ff4aab071c09 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:06.578878 28656 ts_tablet_manager.cc:1929] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.583364 28666 tablet_bootstrap.cc:492] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:06.587277 28656 log.cc:1199] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/c67222a9df344ae48b94ea5e970fd9a8
I20260928 07:56:06.588461 28656 ts_tablet_manager.cc:1950] T c67222a9df344ae48b94ea5e970fd9a8 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:06.591717 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet c67222a9df344ae48b94ea5e970fd9a8 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:06.603132 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet b2695ae64f6d4b5ab81fe9e234025ca7
I20260928 07:56:06.605391 28773 raft_consensus.cc:493] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:06.606211 27822 catalog_manager.cc:6934] ReplaceTablet: tablet b2695ae64f6d4b5ab81fe9e234025ca7 deleted and replaced by tablet 6e11d567741f4acd9c9a3498493c6776
I20260928 07:56:06.605870 28773 raft_consensus.cc:515] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.606448 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e11d567741f4acd9c9a3498493c6776) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:06.604772 28666 tablet_bootstrap.cc:654] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.607906 28773 leader_election.cc:290] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:06.608525 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e11d567741f4acd9c9a3498493c6776) from {username='slave'} at 127.0.0.1:54230
W20260928 07:56:06.610112 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet b2695ae64f6d4b5ab81fe9e234025ca7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2695ae64f6d4b5ab81fe9e234025ca7 already in progress: creating tablet
I20260928 07:56:06.610117 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e11d567741f4acd9c9a3498493c6776) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:06.610175 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d73e199db0a4d93b60a36df144dc58f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:06.611725 28285 leader_election.cc:343] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:06.611850 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d73e199db0a4d93b60a36df144dc58f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:06.613765 28286 leader_election.cc:343] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:06.614195 28286 leader_election.cc:304] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:06.617185 28667 tablet_bootstrap.cc:654] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.619483 28773 raft_consensus.cc:2749] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:06.625015 27826 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 6d54228bdf584a59a7a9ff4aab071c09
I20260928 07:56:06.627594 27826 catalog_manager.cc:6934] ReplaceTablet: tablet 6d54228bdf584a59a7a9ff4aab071c09 deleted and replaced by tablet 4b2bb4f4268e42dabc8afe88f41a8daf
I20260928 07:56:06.628101 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b2bb4f4268e42dabc8afe88f41a8daf) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:06.629271 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b2bb4f4268e42dabc8afe88f41a8daf) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:06.631433 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 6d54228bdf584a59a7a9ff4aab071c09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d54228bdf584a59a7a9ff4aab071c09 already in progress: creating tablet
I20260928 07:56:06.631799 27826 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_182658f932d9407599c8db9fcee8c679" } new_table_name: "default.Table_308d75eb3d2d411cbdf3c7891303e356" modify_external_catalogs: true
I20260928 07:56:06.634284 28658 ts_tablet_manager.cc:1929] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.634727 28658 log.cc:1199] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/0d3aad1a314d4cc39b9b2e42a3022944
I20260928 07:56:06.629783 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b2bb4f4268e42dabc8afe88f41a8daf) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:06.635471 28658 ts_tablet_manager.cc:1950] T 0d3aad1a314d4cc39b9b2e42a3022944 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:06.645278 28662 tablet_bootstrap.cc:492] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:06.645905 28662 ts_tablet_manager.cc:1403] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.122s user 0.018s sys 0.020s
I20260928 07:56:06.649996 28662 raft_consensus.cc:359] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.650641 28662 raft_consensus.cc:385] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.650908 28662 raft_consensus.cc:740] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.656046 28662 consensus_queue.cc:260] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.667186 28662 ts_tablet_manager.cc:1434] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20260928 07:56:06.670601 28657 ts_tablet_manager.cc:1929] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.671011 28657 log.cc:1199] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/0d3aad1a314d4cc39b9b2e42a3022944
I20260928 07:56:06.671638 28657 ts_tablet_manager.cc:1950] T 0d3aad1a314d4cc39b9b2e42a3022944 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:06.673117 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:06.674640 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 0d3aad1a314d4cc39b9b2e42a3022944 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:06.675767 28658 tablet_replica.cc:333] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:06.676452 28658 raft_consensus.cc:2243] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.676879 28658 raft_consensus.cc:2272] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.679927 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 6e11d567741f4acd9c9a3498493c6776 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.680228 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 6e11d567741f4acd9c9a3498493c6776 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.681017 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e11d567741f4acd9c9a3498493c6776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.681159 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e11d567741f4acd9c9a3498493c6776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.683955 28658 ts_tablet_manager.cc:1916] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.687999 28662 tablet_bootstrap.cc:492] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:06.689976 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:06.697748 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 6e11d567741f4acd9c9a3498493c6776 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.699038 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e11d567741f4acd9c9a3498493c6776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.708424 28662 tablet_bootstrap.cc:654] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.711253 28666 tablet_bootstrap.cc:492] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:06.711714 28666 ts_tablet_manager.cc:1403] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.129s user 0.007s sys 0.017s
I20260928 07:56:06.714512 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 0d3aad1a314d4cc39b9b2e42a3022944 (table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:06.715358 28666 raft_consensus.cc:359] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.716234 28666 raft_consensus.cc:385] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.716483 28666 raft_consensus.cc:740] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.719556 28667 tablet_bootstrap.cc:492] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:06.720018 28667 ts_tablet_manager.cc:1403] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.198s user 0.008s sys 0.007s
I20260928 07:56:06.722470 28667 raft_consensus.cc:359] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.723080 28667 raft_consensus.cc:385] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.723343 28667 raft_consensus.cc:740] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
W20260928 07:56:06.725453 27815 catalog_manager.cc:5043] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet b2695ae64f6d4b5ab81fe9e234025ca7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2695ae64f6d4b5ab81fe9e234025ca7 already in progress: creating tablet
I20260928 07:56:06.726311 28657 tablet_replica.cc:333] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:06.727032 28657 raft_consensus.cc:2243] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.727463 28657 raft_consensus.cc:2272] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.729592 28657 ts_tablet_manager.cc:1916] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.723964 28667 consensus_queue.cc:260] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.736687 28667 ts_tablet_manager.cc:1434] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260928 07:56:06.737591 28667 tablet_bootstrap.cc:492] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:06.733719 28666 consensus_queue.cc:260] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.756759 28666 ts_tablet_manager.cc:1434] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.045s user 0.007s sys 0.001s
I20260928 07:56:06.757164 28662 tablet_bootstrap.cc:492] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:06.757602 28662 ts_tablet_manager.cc:1403] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.006s
I20260928 07:56:06.760288 28662 raft_consensus.cc:359] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.760948 28662 raft_consensus.cc:385] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.761195 28662 raft_consensus.cc:740] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.767501 28667 tablet_bootstrap.cc:654] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.768024 28666 tablet_bootstrap.cc:492] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:06.770169 28662 consensus_queue.cc:260] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.778463 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e11d567741f4acd9c9a3498493c6776) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:06.780002 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 01999d17e6c94da586343fc9daa5a59f with delete_type TABLET_DATA_DELETED (replaced by tablet 1e0e52acb3084a78b0a50a6013d7a984) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:06.780447 28773 raft_consensus.cc:493] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:06.780882 28773 raft_consensus.cc:515] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:06.782263 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 01999d17e6c94da586343fc9daa5a59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01999d17e6c94da586343fc9daa5a59f already in progress: creating tablet
I20260928 07:56:06.782994 28773 leader_election.cc:290] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:06.784366 28662 ts_tablet_manager.cc:1434] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20260928 07:56:06.784633 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0e52acb3084a78b0a50a6013d7a984" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:06.786129 28285 leader_election.cc:343] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:06.788296 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0e52acb3084a78b0a50a6013d7a984" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:06.791733 28286 leader_election.cc:343] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:06.792148 28286 leader_election.cc:304] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:06.793509 28666 tablet_bootstrap.cc:654] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.794297 28773 raft_consensus.cc:2749] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:06.795146 28662 tablet_bootstrap.cc:492] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:06.795197 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 01999d17e6c94da586343fc9daa5a59f with delete_type TABLET_DATA_DELETED (replaced by tablet 1e0e52acb3084a78b0a50a6013d7a984) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:06.796039 28656 tablet_replica.cc:333] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:06.796728 28656 raft_consensus.cc:2243] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.797199 28656 raft_consensus.cc:2272] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.799270 28656 ts_tablet_manager.cc:1916] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.800879 27823 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:06.807857 27823 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:06.814203 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 4b2bb4f4268e42dabc8afe88f41a8daf (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.814764 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 4b2bb4f4268e42dabc8afe88f41a8daf (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.815524 28800 raft_consensus.cc:493] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:06.815898 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b2bb4f4268e42dabc8afe88f41a8daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.815973 28800 raft_consensus.cc:515] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.817894 28800 leader_election.cc:290] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:06.819851 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535ad2fe942494bbd892e639d8882c4" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:06.820377 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b2bb4f4268e42dabc8afe88f41a8daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:06.820709 28351 raft_consensus.cc:2468] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:06.829996 28658 ts_tablet_manager.cc:1929] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.830366 28658 log.cc:1199] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/01999d17e6c94da586343fc9daa5a59f
I20260928 07:56:06.830374 28142 leader_election.cc:304] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:06.830956 28658 ts_tablet_manager.cc:1950] T 01999d17e6c94da586343fc9daa5a59f P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:06.826404 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535ad2fe942494bbd892e639d8882c4" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:06.833837 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 01999d17e6c94da586343fc9daa5a59f (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
W20260928 07:56:06.838261 28141 leader_election.cc:343] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:06.843933 28800 raft_consensus.cc:2804] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:06.844888 28667 tablet_bootstrap.cc:492] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:06.845270 28800 raft_consensus.cc:493] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:06.846405 28667 ts_tablet_manager.cc:1403] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.109s user 0.010s sys 0.000s
I20260928 07:56:06.852869 28800 raft_consensus.cc:3060] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:06.857441 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 6d54228bdf584a59a7a9ff4aab071c09 from {username='slave'} at 127.0.0.1:51542
W20260928 07:56:06.858474 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet b2695ae64f6d4b5ab81fe9e234025ca7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2695ae64f6d4b5ab81fe9e234025ca7 already in progress: creating tablet
I20260928 07:56:06.859577 28667 raft_consensus.cc:359] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.860327 28667 raft_consensus.cc:385] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 07:56:06.860455 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 6d54228bdf584a59a7a9ff4aab071c09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d54228bdf584a59a7a9ff4aab071c09 already in progress: creating tablet
I20260928 07:56:06.861150 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 69d6c21b845649ac81e0b98eacaf6fff from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:06.867162 28666 tablet_bootstrap.cc:492] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:06.867619 28666 ts_tablet_manager.cc:1403] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.100s user 0.009s sys 0.011s
I20260928 07:56:06.869479 28662 tablet_bootstrap.cc:654] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.874614 28657 ts_tablet_manager.cc:1929] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:06.875000 28657 log.cc:1199] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/6d54228bdf584a59a7a9ff4aab071c09
I20260928 07:56:06.875613 28657 ts_tablet_manager.cc:1950] T 6d54228bdf584a59a7a9ff4aab071c09 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:06.877935 28667 raft_consensus.cc:740] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.878639 28667 consensus_queue.cc:260] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.897377 28773 raft_consensus.cc:493] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:06.897837 27823 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 69d6c21b845649ac81e0b98eacaf6fff
I20260928 07:56:06.897861 28773 raft_consensus.cc:515] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.900641 28773 leader_election.cc:290] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:06.902060 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6c21b845649ac81e0b98eacaf6fff" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:06.902006 28666 raft_consensus.cc:359] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.902673 28666 raft_consensus.cc:385] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.902900 28666 raft_consensus.cc:740] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
W20260928 07:56:06.903925 28285 leader_election.cc:343] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:06.903617 28666 consensus_queue.cc:260] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.904740 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6c21b845649ac81e0b98eacaf6fff" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:06.905421 28667 ts_tablet_manager.cc:1434] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.059s user 0.005s sys 0.001s
I20260928 07:56:06.907634 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 69d6c21b845649ac81e0b98eacaf6fff with delete_type TABLET_DATA_DELETED (replaced by tablet 35e4db169e1644ad8ef3b248f2c4c586) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:06.907894 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 69d6c21b845649ac81e0b98eacaf6fff with delete_type TABLET_DATA_DELETED (replaced by tablet 35e4db169e1644ad8ef3b248f2c4c586) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:06.868240 28656 ts_tablet_manager.cc:1929] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 07:56:06.909642 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 69d6c21b845649ac81e0b98eacaf6fff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69d6c21b845649ac81e0b98eacaf6fff already in progress: creating tablet
I20260928 07:56:06.911106 27823 catalog_manager.cc:6934] ReplaceTablet: tablet 69d6c21b845649ac81e0b98eacaf6fff deleted and replaced by tablet 35e4db169e1644ad8ef3b248f2c4c586
I20260928 07:56:06.911649 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 4b2bb4f4268e42dabc8afe88f41a8daf (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:06.912631 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b2bb4f4268e42dabc8afe88f41a8daf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:06.906216 28286 leader_election.cc:343] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:06.912087 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 69d6c21b845649ac81e0b98eacaf6fff with delete_type TABLET_DATA_DELETED (replaced by tablet 35e4db169e1644ad8ef3b248f2c4c586) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:06.917193 28286 leader_election.cc:304] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:06.918516 28773 raft_consensus.cc:2749] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:06.908701 28656 log.cc:1199] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/01999d17e6c94da586343fc9daa5a59f
I20260928 07:56:06.922021 28656 ts_tablet_manager.cc:1950] T 01999d17e6c94da586343fc9daa5a59f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:06.923099 27827 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]
I20260928 07:56:06.924657 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 6d54228bdf584a59a7a9ff4aab071c09 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:06.915028 28800 raft_consensus.cc:515] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.930804 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535ad2fe942494bbd892e639d8882c4" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:06.931370 28351 raft_consensus.cc:3060] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:06.932675 28667 tablet_bootstrap.cc:492] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:06.934625 28657 tablet_replica.cc:333] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:06.935312 28666 ts_tablet_manager.cc:1434] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.067s user 0.007s sys 0.001s
I20260928 07:56:06.935457 28657 raft_consensus.cc:2243] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:06.935935 28657 raft_consensus.cc:2272] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:06.921000 28662 tablet_bootstrap.cc:492] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:06.939900 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 01999d17e6c94da586343fc9daa5a59f (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:06.941504 28782 raft_consensus.cc:493] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:06.941939 28782 raft_consensus.cc:515] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.937079 28662 ts_tablet_manager.cc:1403] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.142s user 0.004s sys 0.006s
I20260928 07:56:06.943972 28782 leader_election.cc:290] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:06.944420 28351 raft_consensus.cc:2468] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:06.948843 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14ce2207154262a8a6b4d7b7e1e137" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:06.949131 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14ce2207154262a8a6b4d7b7e1e137" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:06.949633 28350 raft_consensus.cc:2468] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:06.949928 28206 raft_consensus.cc:2468] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:06.950220 28666 tablet_bootstrap.cc:492] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:06.946455 28142 leader_election.cc:304] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:06.950948 28434 leader_election.cc:304] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:06.950829 28662 raft_consensus.cc:359] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.951504 28662 raft_consensus.cc:385] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:06.951822 28662 raft_consensus.cc:740] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:06.952560 28782 raft_consensus.cc:2804] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:06.952929 28782 raft_consensus.cc:493] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:06.953292 28782 raft_consensus.cc:3060] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:06.955564 28657 ts_tablet_manager.cc:1916] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:06.957801 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8535ad2fe942494bbd892e639d8882c4" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:06.958348 28498 raft_consensus.cc:3060] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:06.965685 27815 catalog_manager.cc:5043] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 69d6c21b845649ac81e0b98eacaf6fff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69d6c21b845649ac81e0b98eacaf6fff already in progress: creating tablet
I20260928 07:56:06.967813 28498 raft_consensus.cc:2468] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:06.952636 28662 consensus_queue.cc:260] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:06.970341 28800 leader_election.cc:290] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:06.971598 28667 tablet_bootstrap.cc:654] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.971475 28800 raft_consensus.cc:2804] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:06.972771 28800 raft_consensus.cc:697] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:06.978709 28782 raft_consensus.cc:515] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.980087 28662 ts_tablet_manager.cc:1434] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260928 07:56:06.981011 28662 tablet_bootstrap.cc:492] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:06.989148 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14ce2207154262a8a6b4d7b7e1e137" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:06.990000 28206 raft_consensus.cc:3060] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:06.993556 28667 tablet_bootstrap.cc:492] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:06.993990 28667 ts_tablet_manager.cc:1403] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.061s user 0.009s sys 0.002s
I20260928 07:56:06.997967 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14ce2207154262a8a6b4d7b7e1e137" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:06.999523 28351 raft_consensus.cc:3060] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.000169 28206 raft_consensus.cc:2468] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:07.001365 28782 leader_election.cc:290] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.002244 28662 tablet_bootstrap.cc:654] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:06.996675 28667 raft_consensus.cc:359] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.010561 28667 raft_consensus.cc:385] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.010892 28667 raft_consensus.cc:740] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.011389 28434 leader_election.cc:304] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:07.011571 28667 consensus_queue.cc:260] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.012246 28782 raft_consensus.cc:2804] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:07.013206 28666 tablet_bootstrap.cc:654] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:07.015501 27816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.252:41205, user_credentials={real_user=slave}} blocked reactor thread for 65609.8us
I20260928 07:56:07.017329 28782 raft_consensus.cc:697] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:07.018237 28782 consensus_queue.cc:237] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:06.974188 28800 consensus_queue.cc:237] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.027158 28667 ts_tablet_manager.cc:1434] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20260928 07:56:07.036933 28667 tablet_bootstrap.cc:492] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:07.040733 28351 raft_consensus.cc:2468] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:07.047850 28666 tablet_bootstrap.cc:492] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:07.048266 28666 ts_tablet_manager.cc:1403] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.006s
I20260928 07:56:07.053068 28662 tablet_bootstrap.cc:492] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:07.053524 28662 ts_tablet_manager.cc:1403] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.000s
I20260928 07:56:07.057260 28662 raft_consensus.cc:359] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.058653 28662 raft_consensus.cc:385] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.058897 28662 raft_consensus.cc:740] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.059518 28662 consensus_queue.cc:260] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.042567 28667 tablet_bootstrap.cc:654] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.043699 28657 ts_tablet_manager.cc:1929] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:07.061333 28657 log.cc:1199] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/b2695ae64f6d4b5ab81fe9e234025ca7
I20260928 07:56:07.062072 28657 ts_tablet_manager.cc:1950] T b2695ae64f6d4b5ab81fe9e234025ca7 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:07.064355 28657 tablet_replica.cc:333] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:07.065045 28657 raft_consensus.cc:2243] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:07.065496 28657 raft_consensus.cc:2272] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:07.065578 28666 raft_consensus.cc:359] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.066201 28666 raft_consensus.cc:385] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.066426 28666 raft_consensus.cc:740] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.067126 28657 ts_tablet_manager.cc:1916] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:07.067008 28666 consensus_queue.cc:260] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.067334 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet b2695ae64f6d4b5ab81fe9e234025ca7 (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:07.068667 28666 ts_tablet_manager.cc:1434] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260928 07:56:07.069646 28662 ts_tablet_manager.cc:1434] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260928 07:56:07.070504 28662 tablet_bootstrap.cc:492] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:07.095055 28666 tablet_bootstrap.cc:492] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:07.100319 28662 tablet_bootstrap.cc:654] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.102399 27823 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:07.105263 28657 ts_tablet_manager.cc:1929] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:07.109282 28657 log.cc:1199] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/69d6c21b845649ac81e0b98eacaf6fff
I20260928 07:56:07.110603 28657 ts_tablet_manager.cc:1950] T 69d6c21b845649ac81e0b98eacaf6fff P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:07.113956 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 69d6c21b845649ac81e0b98eacaf6fff (table default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]) successfully deleted
I20260928 07:56:07.128398 28666 tablet_bootstrap.cc:654] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.128929 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 35e4db169e1644ad8ef3b248f2c4c586 (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.129797 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b2bb4f4268e42dabc8afe88f41a8daf) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:07.130097 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e4db169e1644ad8ef3b248f2c4c586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.131870 27822 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:07.133574 28656 tablet_replica.cc:333] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:07.132995 27822 catalog_manager.cc:5838] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:07.134263 28656 raft_consensus.cc:2243] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:07.134222 27822 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:07.134677 28656 raft_consensus.cc:2272] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:07.134933 28662 tablet_bootstrap.cc:492] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:07.135299 28662 ts_tablet_manager.cc:1403] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.000s
I20260928 07:56:07.137061 28656 ts_tablet_manager.cc:1916] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:07.137612 28662 raft_consensus.cc:359] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.138512 28662 raft_consensus.cc:385] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.138886 28662 raft_consensus.cc:740] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.147514 28662 consensus_queue.cc:260] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.149633 28662 ts_tablet_manager.cc:1434] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.014s user 0.008s sys 0.000s
I20260928 07:56:07.150409 28666 tablet_bootstrap.cc:492] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:07.150816 28666 ts_tablet_manager.cc:1403] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.056s user 0.008s sys 0.001s
I20260928 07:56:07.167374 28666 raft_consensus.cc:359] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.167760 28662 tablet_bootstrap.cc:492] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:07.168015 28666 raft_consensus.cc:385] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.168264 28666 raft_consensus.cc:740] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.180388 28656 ts_tablet_manager.cc:1929] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:07.182036 28656 log.cc:1199] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/6d54228bdf584a59a7a9ff4aab071c09
I20260928 07:56:07.183218 28656 ts_tablet_manager.cc:1950] T 6d54228bdf584a59a7a9ff4aab071c09 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:07.184031 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 35e4db169e1644ad8ef3b248f2c4c586 (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.185299 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e4db169e1644ad8ef3b248f2c4c586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.176569 28666 consensus_queue.cc:260] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.178927 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 35e4db169e1644ad8ef3b248f2c4c586 (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.186452 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e4db169e1644ad8ef3b248f2c4c586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.187659 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 6d54228bdf584a59a7a9ff4aab071c09 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:07.201994 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b2bb4f4268e42dabc8afe88f41a8daf) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:07.202977 28658 tablet_replica.cc:333] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:07.204200 28658 raft_consensus.cc:2243] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:07.204635 28658 raft_consensus.cc:2272] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:07.207736 28658 ts_tablet_manager.cc:1916] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:07.219858 27823 catalog_manager.cc:5838] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:07.222290 28666 ts_tablet_manager.cc:1434] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.071s user 0.005s sys 0.002s
I20260928 07:56:07.231268 28666 tablet_bootstrap.cc:492] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:07.234444 27823 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:07.225503 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 69d6c21b845649ac81e0b98eacaf6fff from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:07.237499 28662 tablet_bootstrap.cc:654] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.239010 28667 tablet_bootstrap.cc:492] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:07.239496 28667 ts_tablet_manager.cc:1403] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.203s user 0.030s sys 0.020s
I20260928 07:56:07.241942 28667 raft_consensus.cc:359] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.242558 28667 raft_consensus.cc:385] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.242836 28667 raft_consensus.cc:740] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.243726 28667 consensus_queue.cc:260] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.255419 28667 ts_tablet_manager.cc:1434] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260928 07:56:07.258466 28667 tablet_bootstrap.cc:492] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:07.262950 28662 tablet_bootstrap.cc:492] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:07.263362 28662 ts_tablet_manager.cc:1403] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.000s
I20260928 07:56:07.264155 28667 tablet_bootstrap.cc:654] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.264155 28658 ts_tablet_manager.cc:1929] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:07.265944 28662 raft_consensus.cc:359] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.266604 28662 raft_consensus.cc:385] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.266947 28662 raft_consensus.cc:740] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.267602 28662 consensus_queue.cc:260] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.270507 27828 catalog_manager.cc:3541] renamed table default.table_b683bb3b8dc3479ea1bb3735c0fb55af [id=8050a64da16d4203b539e643bf5c92a9] in HMS: new name default.table_579ed77832b347ea98ea15d75bc5775d
I20260928 07:56:07.271229 28773 raft_consensus.cc:493] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.275615 28658 log.cc:1199] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/6d54228bdf584a59a7a9ff4aab071c09
I20260928 07:56:07.271678 28773 raft_consensus.cc:515] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.276314 28658 ts_tablet_manager.cc:1950] T 6d54228bdf584a59a7a9ff4aab071c09 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:07.277396 28773 leader_election.cc:290] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:07.277693 28667 tablet_bootstrap.cc:492] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:07.278096 28667 ts_tablet_manager.cc:1403] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.004s
I20260928 07:56:07.279030 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 6d54228bdf584a59a7a9ff4aab071c09 (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:07.266460 28666 tablet_bootstrap.cc:654] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.279666 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e11d567741f4acd9c9a3498493c6776" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:07.281081 28667 raft_consensus.cc:359] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.281698 28667 raft_consensus.cc:385] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.281666 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e11d567741f4acd9c9a3498493c6776" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:07.281958 28667 raft_consensus.cc:740] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
W20260928 07:56:07.283478 28285 leader_election.cc:343] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:07.284634 28286 leader_election.cc:343] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.285020 28286 leader_election.cc:304] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:07.286592 28773 raft_consensus.cc:2749] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:07.293578 28667 consensus_queue.cc:260] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.294586 28662 ts_tablet_manager.cc:1434] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.031s user 0.007s sys 0.000s
I20260928 07:56:07.295517 28666 tablet_bootstrap.cc:492] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:07.297878 28667 ts_tablet_manager.cc:1434] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20260928 07:56:07.300331 28666 ts_tablet_manager.cc:1403] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.007s
I20260928 07:56:07.308413 28662 tablet_bootstrap.cc:492] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:07.314930 28666 raft_consensus.cc:359] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.315575 28666 raft_consensus.cc:385] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.315552 28773 raft_consensus.cc:493] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.315817 28666 raft_consensus.cc:740] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.316017 28773 raft_consensus.cc:515] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.316444 28666 consensus_queue.cc:260] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.317433 28800 raft_consensus.cc:493] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.318023 28773 leader_election.cc:290] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:07.317914 28800 raft_consensus.cc:515] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.319944 28800 leader_election.cc:290] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.320135 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97ca287aa0e4ffcb387cc1c144a5a31" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:07.321441 28285 leader_election.cc:343] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.322592 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d73e199db0a4d93b60a36df144dc58f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:07.322899 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97ca287aa0e4ffcb387cc1c144a5a31" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:07.323196 28351 raft_consensus.cc:2468] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:07.324376 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d73e199db0a4d93b60a36df144dc58f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:07.324538 28142 leader_election.cc:304] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:07.324966 28498 raft_consensus.cc:2468] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:07.325412 28800 raft_consensus.cc:2804] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:07.325731 28800 raft_consensus.cc:493] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:07.326051 28800 raft_consensus.cc:3060] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:07.327155 28286 leader_election.cc:343] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.327570 28286 leader_election.cc:304] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:07.329406 28773 raft_consensus.cc:2749] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:07.332835 28800 raft_consensus.cc:515] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.335578 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d73e199db0a4d93b60a36df144dc58f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:07.336035 28666 ts_tablet_manager.cc:1434] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260928 07:56:07.336123 28498 raft_consensus.cc:3060] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.338267 28662 tablet_bootstrap.cc:654] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.345568 28498 raft_consensus.cc:2468] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:07.346858 28141 leader_election.cc:304] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:07.347744 28846 raft_consensus.cc:2804] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:07.348214 28846 raft_consensus.cc:697] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:07.349799 28666 tablet_bootstrap.cc:492] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:07.349018 28846 consensus_queue.cc:237] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.354032 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d73e199db0a4d93b60a36df144dc58f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:07.354606 28351 raft_consensus.cc:3060] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.358673 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b2bb4f4268e42dabc8afe88f41a8daf) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:07.360255 27814 catalog_manager.cc:5030] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 6d54228bdf584a59a7a9ff4aab071c09 because the tablet was not found. No further retry: Not found: Tablet not found: 6d54228bdf584a59a7a9ff4aab071c09
I20260928 07:56:07.362274 28351 raft_consensus.cc:2468] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:07.363605 28800 leader_election.cc:290] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.367180 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d54228bdf584a59a7a9ff4aab071c09 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b2bb4f4268e42dabc8afe88f41a8daf) from {username='slave'} at 127.0.0.1:54230
W20260928 07:56:07.368690 27815 catalog_manager.cc:5030] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 6d54228bdf584a59a7a9ff4aab071c09 because the tablet was not found. No further retry: Not found: Tablet not found: 6d54228bdf584a59a7a9ff4aab071c09
I20260928 07:56:07.371660 28666 tablet_bootstrap.cc:654] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.387434 28846 raft_consensus.cc:493] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.388020 28846 raft_consensus.cc:515] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.390450 28846 leader_election.cc:290] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.390697 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aff6b3ddcb44089c0c1f938ed457b5" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:07.391263 28498 raft_consensus.cc:2468] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:07.391844 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aff6b3ddcb44089c0c1f938ed457b5" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:07.392437 28351 raft_consensus.cc:2468] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:07.392475 28141 leader_election.cc:304] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:07.393329 28846 raft_consensus.cc:2804] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:07.393661 28846 raft_consensus.cc:493] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:07.393967 28846 raft_consensus.cc:3060] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.394145 28667 tablet_bootstrap.cc:492] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:07.399950 28667 tablet_bootstrap.cc:654] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.403571 27823 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:07.405441 28662 tablet_bootstrap.cc:492] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:07.405866 28662 ts_tablet_manager.cc:1403] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.111s user 0.013s sys 0.000s
I20260928 07:56:07.408625 28662 raft_consensus.cc:359] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.409262 28662 raft_consensus.cc:385] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.409564 28662 raft_consensus.cc:740] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.409852 28666 tablet_bootstrap.cc:492] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:07.410257 28666 ts_tablet_manager.cc:1403] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.066s user 0.008s sys 0.001s
I20260928 07:56:07.410166 28662 consensus_queue.cc:260] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.412642 28666 raft_consensus.cc:359] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.421144 27822 catalog_manager.cc:5838] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:07.427465 28662 ts_tablet_manager.cc:1434] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260928 07:56:07.428313 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 1e0e52acb3084a78b0a50a6013d7a984 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:07.436897 28662 tablet_bootstrap.cc:492] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:07.427274 28846 raft_consensus.cc:515] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.438169 28666 raft_consensus.cc:385] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.438472 28666 raft_consensus.cc:740] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.441205 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aff6b3ddcb44089c0c1f938ed457b5" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:07.441756 28498 raft_consensus.cc:3060] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.447510 27829 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]
I20260928 07:56:07.448608 28498 raft_consensus.cc:2468] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:07.449882 28141 leader_election.cc:304] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:07.451416 28666 consensus_queue.cc:260] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.452167 28800 raft_consensus.cc:2804] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:07.452674 28800 raft_consensus.cc:697] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:07.453635 28800 consensus_queue.cc:237] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.462649 28666 ts_tablet_manager.cc:1434] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.052s user 0.006s sys 0.000s
I20260928 07:56:07.472916 28846 leader_election.cc:290] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.473124 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aff6b3ddcb44089c0c1f938ed457b5" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:07.473730 28351 raft_consensus.cc:3060] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.474812 28662 tablet_bootstrap.cc:654] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.480135 28666 tablet_bootstrap.cc:492] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:07.480134 28667 tablet_bootstrap.cc:492] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:07.480551 28667 ts_tablet_manager.cc:1403] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.087s user 0.007s sys 0.033s
I20260928 07:56:07.483856 27823 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 1e0e52acb3084a78b0a50a6013d7a984
I20260928 07:56:07.486792 28667 raft_consensus.cc:359] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.487421 28667 raft_consensus.cc:385] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.487665 28667 raft_consensus.cc:740] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.488118 28782 raft_consensus.cc:493] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.488472 28667 consensus_queue.cc:260] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.488547 28782 raft_consensus.cc:515] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.490017 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e0e52acb3084a78b0a50a6013d7a984 with delete_type TABLET_DATA_DELETED (replaced by tablet c682ee6d2eaf4bd3902e35b9bec3db0d) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:07.490490 28782 leader_election.cc:290] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.490794 28656 tablet_replica.cc:333] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:07.491222 28351 raft_consensus.cc:2468] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:07.491501 28656 raft_consensus.cc:2243] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:07.491925 28656 raft_consensus.cc:2272] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:07.492432 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6c21b845649ac81e0b98eacaf6fff" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:07.493010 28206 raft_consensus.cc:2468] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
W20260928 07:56:07.493916 28434 leader_election.cc:343] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 69d6c21b845649ac81e0b98eacaf6fff
I20260928 07:56:07.494210 28656 ts_tablet_manager.cc:1916] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:07.494560 28434 leader_election.cc:304] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:07.495496 28782 raft_consensus.cc:2804] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:07.495821 28782 raft_consensus.cc:493] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:07.496110 28782 raft_consensus.cc:3060] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.500378 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e0e52acb3084a78b0a50a6013d7a984 with delete_type TABLET_DATA_DELETED (replaced by tablet c682ee6d2eaf4bd3902e35b9bec3db0d) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:07.502070 27814 catalog_manager.cc:5043] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 1e0e52acb3084a78b0a50a6013d7a984 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e0e52acb3084a78b0a50a6013d7a984 already in progress: creating tablet
I20260928 07:56:07.503057 28667 ts_tablet_manager.cc:1434] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.022s user 0.003s sys 0.004s
I20260928 07:56:07.505939 28782 raft_consensus.cc:515] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.507169 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e0e52acb3084a78b0a50a6013d7a984 with delete_type TABLET_DATA_DELETED (replaced by tablet c682ee6d2eaf4bd3902e35b9bec3db0d) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:07.507829 28657 tablet_replica.cc:333] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:07.508496 28657 raft_consensus.cc:2243] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:07.508903 28657 raft_consensus.cc:2272] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:07.509589 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6c21b845649ac81e0b98eacaf6fff" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:07.510133 28206 raft_consensus.cc:3060] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.510546 28657 ts_tablet_manager.cc:1916] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:07.516263 28206 raft_consensus.cc:2468] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:07.517503 28434 leader_election.cc:304] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:07.516450 27823 catalog_manager.cc:6934] ReplaceTablet: tablet 1e0e52acb3084a78b0a50a6013d7a984 deleted and replaced by tablet c682ee6d2eaf4bd3902e35b9bec3db0d
I20260928 07:56:07.518982 28849 raft_consensus.cc:2804] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:07.522954 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 69d6c21b845649ac81e0b98eacaf6fff with delete_type TABLET_DATA_DELETED (replaced by tablet 35e4db169e1644ad8ef3b248f2c4c586) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:07.523622 28658 tablet_replica.cc:333] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:07.526405 28849 raft_consensus.cc:697] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:07.528239 28849 consensus_queue.cc:237] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:07.540321 28434 leader_election.cc:343] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 69d6c21b845649ac81e0b98eacaf6fff
I20260928 07:56:07.540591 28782 leader_election.cc:290] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.542969 28662 tablet_bootstrap.cc:492] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:07.543421 28662 ts_tablet_manager.cc:1403] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.107s user 0.009s sys 0.000s
I20260928 07:56:07.546877 28184 tablet_service.cc:1511] Processing CreateTablet for tablet c682ee6d2eaf4bd3902e35b9bec3db0d (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.547921 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c682ee6d2eaf4bd3902e35b9bec3db0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.550612 28657 ts_tablet_manager.cc:1929] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:07.550971 28657 log.cc:1199] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/1e0e52acb3084a78b0a50a6013d7a984
I20260928 07:56:07.551627 28657 ts_tablet_manager.cc:1950] T 1e0e52acb3084a78b0a50a6013d7a984 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:07.551826 28330 tablet_service.cc:1511] Processing CreateTablet for tablet c682ee6d2eaf4bd3902e35b9bec3db0d (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.552766 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c682ee6d2eaf4bd3902e35b9bec3db0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.554183 28666 tablet_bootstrap.cc:654] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.559722 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 1e0e52acb3084a78b0a50a6013d7a984 (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:07.563094 28662 raft_consensus.cc:359] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.563825 28662 raft_consensus.cc:385] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.564110 28662 raft_consensus.cc:740] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.572710 28477 tablet_service.cc:1511] Processing CreateTablet for tablet c682ee6d2eaf4bd3902e35b9bec3db0d (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.573760 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c682ee6d2eaf4bd3902e35b9bec3db0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.577319 28658 raft_consensus.cc:2243] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:07.580191 28658 pending_rounds.cc:70] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Trying to abort 1 pending ops.
I20260928 07:56:07.580462 28658 pending_rounds.cc:77] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224558204731392 op_type: NO_OP noop_request { }
I20260928 07:56:07.580971 28658 raft_consensus.cc:2889] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:07.581312 28658 raft_consensus.cc:2272] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:07.564823 28662 consensus_queue.cc:260] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.589413 27820 catalog_manager.cc:2213] created HMS catalog entry for table [id=88fa2ddd307e49ab85b4eaa911b6669b]
I20260928 07:56:07.595283 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 2b14ce2207154262a8a6b4d7b7e1e137 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:07.596495 28662 ts_tablet_manager.cc:1434] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.053s user 0.007s sys 0.000s
I20260928 07:56:07.600057 28662 tablet_bootstrap.cc:492] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:07.604439 28656 ts_tablet_manager.cc:1929] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:07.604800 28656 log.cc:1199] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/1e0e52acb3084a78b0a50a6013d7a984
I20260928 07:56:07.609030 28666 tablet_bootstrap.cc:492] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:07.609455 28666 ts_tablet_manager.cc:1403] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.131s user 0.013s sys 0.004s
I20260928 07:56:07.615731 28666 raft_consensus.cc:359] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.592736 27823 catalog_manager.cc:5838] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:07.616416 28666 raft_consensus.cc:385] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.617938 28666 raft_consensus.cc:740] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.619364 28666 consensus_queue.cc:260] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.620731 28667 tablet_bootstrap.cc:492] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:07.620602 27820 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 61) took 1628 ms. Trace:
I20260928 07:56:07.621663 28800 raft_consensus.cc:493] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.622130 28800 raft_consensus.cc:515] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.624259 28800 leader_election.cc:290] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.626588 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2695ae64f6d4b5ab81fe9e234025ca7" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:07.627645 28662 tablet_bootstrap.cc:654] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:07.627871 28142 leader_election.cc:343] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: b2695ae64f6d4b5ab81fe9e234025ca7
I20260928 07:56:07.628127 28667 tablet_bootstrap.cc:654] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:07.630039 28141 leader_election.cc:343] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.630481 28141 leader_election.cc:304] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:07.633041 28666 ts_tablet_manager.cc:1434] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.023s user 0.005s sys 0.001s
I20260928 07:56:07.620956 27820 rpcz_store.cc:276] 0928 07:56:05.991988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:05.992854 (+ 866us) service_pool.cc:224] Handling call
0928 07:56:06.434117 (+441263us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:06.436186 (+ 2069us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:07.589365 (+1153179us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:07.619826 (+ 30461us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:07.620202 (+ 376us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:07.620537 (+ 335us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:07.591128 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:07.591513 (+ 385us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:07.591537 (+ 24us) write_op.cc:435] Acquired schema lock
0928 07:56:07.591549 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:07.591814 (+ 265us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:07.591857 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:07.591881 (+ 24us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:07.592078 (+ 197us) tablet.cc:701] Row locks acquired
0928 07:56:07.592091 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:07.592206 (+ 115us) write_op.cc:270] Start()
0928 07:56:07.592290 (+ 84us) write_op.cc:276] Timestamp: P: 1790582167592157 usec, L: 0
0928 07:56:07.592304 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 07:56:07.592764 (+ 460us) log.cc:844] Serialized 432 byte log entry
0928 07:56:07.616822 (+ 24058us) op_driver.cc:464] REPLICATION: finished
0928 07:56:07.617316 (+ 494us) write_op.cc:301] APPLY: starting
0928 07:56:07.617373 (+ 57us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:07.617478 (+ 105us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:07.617576 (+ 98us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:07.617960 (+ 384us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:07.618094 (+ 134us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:07.618134 (+ 40us) write_op.cc:312] APPLY: finished
0928 07:56:07.618314 (+ 180us) log.cc:844] Serialized 28 byte log entry
0928 07:56:07.618465 (+ 151us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:07.618529 (+ 64us) write_op.cc:454] Released schema lock
0928 07:56:07.618559 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:07.618771 (+ 212us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:07.618808 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1008505,"Hive Metastore.run_cpu_time_us":806,"Hive Metastore.run_wall_time_us":143417,"spinlock_wait_cycles":71040,"child_traces":[["op",{"apply.queue_time_us":316,"apply.run_cpu_time_us":1428,"apply.run_wall_time_us":1427,"num_ops":2,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":1956,"prepare.run_wall_time_us":1957,"raft.queue_time_us":3328,"raft.run_cpu_time_us":736,"raft.run_wall_time_us":736,"replication_time_us":24394}]]}
I20260928 07:56:07.643769 28666 tablet_bootstrap.cc:492] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:07.647445 28667 tablet_bootstrap.cc:492] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:07.647912 28667 ts_tablet_manager.cc:1403] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.027s user 0.013s sys 0.000s
I20260928 07:56:07.649626 28656 ts_tablet_manager.cc:1950] T 1e0e52acb3084a78b0a50a6013d7a984 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:07.653138 28667 raft_consensus.cc:359] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.659966 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 2b14ce2207154262a8a6b4d7b7e1e137
I20260928 07:56:07.663457 28666 tablet_bootstrap.cc:654] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.663815 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b14ce2207154262a8a6b4d7b7e1e137 with delete_type TABLET_DATA_DELETED (replaced by tablet c66d29eed5714db597516c573326153c) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:07.664523 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b14ce2207154262a8a6b4d7b7e1e137 with delete_type TABLET_DATA_DELETED (replaced by tablet c66d29eed5714db597516c573326153c) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:07.665066 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 2b14ce2207154262a8a6b4d7b7e1e137 deleted and replaced by tablet c66d29eed5714db597516c573326153c
I20260928 07:56:07.668049 28657 tablet_replica.cc:333] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:07.668768 28657 raft_consensus.cc:2243] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:07.669257 28657 raft_consensus.cc:2272] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:07.670969 28657 ts_tablet_manager.cc:1916] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:07.681823 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b14ce2207154262a8a6b4d7b7e1e137 with delete_type TABLET_DATA_DELETED (replaced by tablet c66d29eed5714db597516c573326153c) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:07.682731 28800 raft_consensus.cc:2749] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:07.683626 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 1e0e52acb3084a78b0a50a6013d7a984 (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:07.685403 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 69d6c21b845649ac81e0b98eacaf6fff with delete_type TABLET_DATA_DELETED (replaced by tablet 35e4db169e1644ad8ef3b248f2c4c586) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:07.685580 28666 tablet_bootstrap.cc:492] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:07.686002 28666 ts_tablet_manager.cc:1403] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.042s user 0.011s sys 0.000s
I20260928 07:56:07.688529 28656 tablet_replica.cc:333] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:07.694835 28658 ts_tablet_manager.cc:1916] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:07.696599 28666 raft_consensus.cc:359] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.697271 28666 raft_consensus.cc:385] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.697630 28666 raft_consensus.cc:740] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.707139 28849 raft_consensus.cc:493] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.707636 28849 raft_consensus.cc:515] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.709805 28849 leader_election.cc:290] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.709940 28666 consensus_queue.cc:260] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.711830 28666 ts_tablet_manager.cc:1434] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
W20260928 07:56:07.714479 28434 leader_election.cc:343] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 1e0e52acb3084a78b0a50a6013d7a984
W20260928 07:56:07.715245 28434 leader_election.cc:343] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 1e0e52acb3084a78b0a50a6013d7a984
I20260928 07:56:07.715619 28434 leader_election.cc:304] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:07.717039 28782 raft_consensus.cc:2749] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:07.717916 28773 raft_consensus.cc:493] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.718056 28662 tablet_bootstrap.cc:492] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:07.718403 28773 raft_consensus.cc:515] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.718662 28662 ts_tablet_manager.cc:1403] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.119s user 0.008s sys 0.002s
I20260928 07:56:07.720448 28773 leader_election.cc:290] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:07.728451 28666 tablet_bootstrap.cc:492] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:07.729403 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa47d4f3bbb45f89a1750e512614b98" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:07.731295 28477 tablet_service.cc:1511] Processing CreateTablet for tablet d9220066aaeb4417a73707bd5679846f (DEFAULT_TABLE table=default.table_66df2d021af141bf9af764fb609f0941 [id=88fa2ddd307e49ab85b4eaa911b6669b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 07:56:07.731642 28286 leader_election.cc:343] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.732585 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9220066aaeb4417a73707bd5679846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.733304 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa47d4f3bbb45f89a1750e512614b98" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:07.734773 28285 leader_election.cc:343] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.735198 28285 leader_election.cc:304] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:07.736325 28773 raft_consensus.cc:2749] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:07.659140 28667 raft_consensus.cc:385] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.737601 28667 raft_consensus.cc:740] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.738982 28667 consensus_queue.cc:260] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.739405 28662 raft_consensus.cc:359] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.740070 28662 raft_consensus.cc:385] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.740345 28662 raft_consensus.cc:740] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.741011 28667 ts_tablet_manager.cc:1434] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.093s user 0.005s sys 0.000s
I20260928 07:56:07.741206 28662 consensus_queue.cc:260] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.742516 28351 raft_consensus.cc:1275] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Refusing update from remote peer acdaa3cf2ffd45f5b55a169c1bacead5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:07.745424 28846 consensus_queue.cc:1048] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:07.746810 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b2bb4f4268e42dabc8afe88f41a8daf from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:07.750314 28666 tablet_bootstrap.cc:654] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.751734 28662 ts_tablet_manager.cc:1434] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.032s user 0.005s sys 0.000s
I20260928 07:56:07.760514 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e0e52acb3084a78b0a50a6013d7a984 with delete_type TABLET_DATA_DELETED (replaced by tablet c682ee6d2eaf4bd3902e35b9bec3db0d) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:07.761793 28498 raft_consensus.cc:1275] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Refusing update from remote peer acdaa3cf2ffd45f5b55a169c1bacead5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:07.762461 28666 tablet_bootstrap.cc:492] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:07.762899 28666 ts_tablet_manager.cc:1403] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.004s
I20260928 07:56:07.771379 28800 consensus_queue.cc:1048] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:07.777199 28666 raft_consensus.cc:359] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.777875 28666 raft_consensus.cc:385] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.778117 28666 raft_consensus.cc:740] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.781797 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 4b2bb4f4268e42dabc8afe88f41a8daf
I20260928 07:56:07.783758 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b2bb4f4268e42dabc8afe88f41a8daf with delete_type TABLET_DATA_DELETED (replaced by tablet 8ad8656a1c06494b9ebc9eb2e9512b41) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:07.784952 28185 tablet_service.cc:1511] Processing CreateTablet for tablet d9220066aaeb4417a73707bd5679846f (DEFAULT_TABLE table=default.table_66df2d021af141bf9af764fb609f0941 [id=88fa2ddd307e49ab85b4eaa911b6669b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.786130 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9220066aaeb4417a73707bd5679846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.781319 28666 consensus_queue.cc:260] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.793172 28666 ts_tablet_manager.cc:1434] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20260928 07:56:07.793933 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b2bb4f4268e42dabc8afe88f41a8daf with delete_type TABLET_DATA_DELETED (replaced by tablet 8ad8656a1c06494b9ebc9eb2e9512b41) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:07.796051 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b2bb4f4268e42dabc8afe88f41a8daf with delete_type TABLET_DATA_DELETED (replaced by tablet 8ad8656a1c06494b9ebc9eb2e9512b41) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:07.796428 28849 raft_consensus.cc:493] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.796754 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 4b2bb4f4268e42dabc8afe88f41a8daf deleted and replaced by tablet 8ad8656a1c06494b9ebc9eb2e9512b41
I20260928 07:56:07.796878 28849 raft_consensus.cc:515] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.797374 28666 tablet_bootstrap.cc:492] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:07.798802 28849 leader_election.cc:290] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.800962 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97ca287aa0e4ffcb387cc1c144a5a31" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:07.801728 28350 raft_consensus.cc:2468] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:07.802984 28434 leader_election.cc:304] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:07.803743 28849 raft_consensus.cc:2804] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:07.804075 28849 raft_consensus.cc:493] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:07.804816 28849 raft_consensus.cc:3060] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.808882 28773 raft_consensus.cc:493] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.809610 28773 raft_consensus.cc:515] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.815546 28666 tablet_bootstrap.cc:654] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.815508 28773 leader_election.cc:290] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:07.816697 28773 raft_consensus.cc:493] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.817642 28773 raft_consensus.cc:515] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.823026 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e4db169e1644ad8ef3b248f2c4c586" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:07.818598 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682ee6d2eaf4bd3902e35b9bec3db0d" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:07.824757 28285 leader_election.cc:343] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.787245 28662 tablet_bootstrap.cc:492] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:07.801254 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97ca287aa0e4ffcb387cc1c144a5a31" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:07.826128 28206 raft_consensus.cc:2468] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:07.814085 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682ee6d2eaf4bd3902e35b9bec3db0d" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:07.820405 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e4db169e1644ad8ef3b248f2c4c586" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:07.828655 28286 leader_election.cc:343] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:07.829398 28286 leader_election.cc:343] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.829838 28286 leader_election.cc:304] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
W20260928 07:56:07.831650 28285 leader_election.cc:343] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:07.832119 28285 leader_election.cc:304] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:07.843351 28187 tablet_service.cc:1511] Processing CreateTablet for tablet c66d29eed5714db597516c573326153c (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.844309 28662 tablet_bootstrap.cc:654] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:07.844338 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66d29eed5714db597516c573326153c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.844969 28329 tablet_service.cc:1511] Processing CreateTablet for tablet c66d29eed5714db597516c573326153c (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.845973 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66d29eed5714db597516c573326153c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.796084 28330 tablet_service.cc:1511] Processing CreateTablet for tablet d9220066aaeb4417a73707bd5679846f (DEFAULT_TABLE table=default.table_66df2d021af141bf9af764fb609f0941 [id=88fa2ddd307e49ab85b4eaa911b6669b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.859556 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9220066aaeb4417a73707bd5679846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.865538 28656 raft_consensus.cc:2243] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:07.866068 28656 raft_consensus.cc:2272] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:07.870469 28782 raft_consensus.cc:493] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:07.870945 28782 raft_consensus.cc:515] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:07.872884 28782 leader_election.cc:290] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:07.873745 28479 tablet_service.cc:1511] Processing CreateTablet for tablet c66d29eed5714db597516c573326153c (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.874708 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66d29eed5714db597516c573326153c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.877691 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e11d567741f4acd9c9a3498493c6776) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:07.885504 28773 leader_election.cc:290] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:07.886332 28773 raft_consensus.cc:2749] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:07.886404 27823 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_cf58487e79464a79a31128dfc7c26d09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:07.887014 28773 raft_consensus.cc:2749] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:07.893605 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 69d6c21b845649ac81e0b98eacaf6fff from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:07.899312 28656 ts_tablet_manager.cc:1916] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:07.904747 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2695ae64f6d4b5ab81fe9e234025ca7" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:07.905800 28205 raft_consensus.cc:2468] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:07.913785 28662 tablet_bootstrap.cc:492] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:07.914332 28662 ts_tablet_manager.cc:1403] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.127s user 0.014s sys 0.000s
I20260928 07:56:07.917441 28658 ts_tablet_manager.cc:1929] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 07:56:07.920004 27816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260928 07:56:07.921630 28667 tablet_bootstrap.cc:492] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:07.923297 28657 ts_tablet_manager.cc:1929] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 07:56:07.936005 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260928 07:56:07.938134 28662 raft_consensus.cc:359] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.938961 28662 raft_consensus.cc:385] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:07.939265 28662 raft_consensus.cc:740] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:07.940202 28662 consensus_queue.cc:260] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:07.954767 28662 ts_tablet_manager.cc:1434] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.040s user 0.007s sys 0.000s
I20260928 07:56:07.968173 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.927273 28667 tablet_bootstrap.cc:654] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:07.933787 28285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 102153us
I20260928 07:56:07.968343 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:07.974292 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad8656a1c06494b9ebc9eb2e9512b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:07.985606 28657 log.cc:1199] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/2b14ce2207154262a8a6b4d7b7e1e137
I20260928 07:56:07.986613 28657 ts_tablet_manager.cc:1950] T 2b14ce2207154262a8a6b4d7b7e1e137 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:07.995690 28667 tablet_bootstrap.cc:492] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:07.996134 28667 ts_tablet_manager.cc:1403] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.075s user 0.010s sys 0.019s
I20260928 07:56:07.998592 28667 raft_consensus.cc:359] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.000130 28667 raft_consensus.cc:385] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.000382 28667 raft_consensus.cc:740] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.001144 28667 consensus_queue.cc:260] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.007732 27822 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:08.008801 28667 ts_tablet_manager.cc:1434] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260928 07:56:08.013394 28662 tablet_bootstrap.cc:492] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:08.023665 27822 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:08.028983 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad8656a1c06494b9ebc9eb2e9512b41. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:08.030702 27822 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c66d29eed5714db597516c573326153c consensus state has no leader
W20260928 07:56:07.918848 28434 leader_election.cc:343] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: b2695ae64f6d4b5ab81fe9e234025ca7
I20260928 07:56:08.033025 27820 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
W20260928 07:56:08.033617 28434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 114805us
W20260928 07:56:08.034525 28434 consensus_peers.cc:597] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:08.035151 28434 leader_election.cc:304] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:07.927700 28849 raft_consensus.cc:515] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.037573 28782 raft_consensus.cc:2804] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:08.037969 28782 raft_consensus.cc:493] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:08.038329 28782 raft_consensus.cc:3060] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:07.950930 28666 tablet_bootstrap.cc:492] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:08.042007 28666 ts_tablet_manager.cc:1403] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.248s user 0.030s sys 0.027s
I20260928 07:56:08.043354 28886 tablet.cc:1751] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 07:56:08.044582 28666 raft_consensus.cc:359] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.046563 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 6e11d567741f4acd9c9a3498493c6776 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:07.972584 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 (DEFAULT_TABLE table=default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.045207 28666 raft_consensus.cc:385] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.057807 28666 raft_consensus.cc:740] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.048873 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad8656a1c06494b9ebc9eb2e9512b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.058645 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97ca287aa0e4ffcb387cc1c144a5a31" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:08.059198 28205 raft_consensus.cc:3060] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.062597 28666 consensus_queue.cc:260] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.062924 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97ca287aa0e4ffcb387cc1c144a5a31" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:08.063467 28350 raft_consensus.cc:3060] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.050619 28849 leader_election.cc:290] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:08.069051 28875 raft_consensus.cc:493] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:08.069582 28875 raft_consensus.cc:515] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.072587 28875 leader_election.cc:290] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:08.072894 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b2bb4f4268e42dabc8afe88f41a8daf" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:08.076077 28286 leader_election.cc:343] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:08.081729 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b2bb4f4268e42dabc8afe88f41a8daf" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:08.083213 28285 leader_election.cc:343] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:08.083820 28285 leader_election.cc:304] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:08.085595 28875 raft_consensus.cc:2749] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:08.085031 28782 raft_consensus.cc:515] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:08.090246 27815 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c66d29eed5714db597516c573326153c consensus state has no leader
I20260928 07:56:08.090476 28658 log.cc:1199] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/69d6c21b845649ac81e0b98eacaf6fff
I20260928 07:56:08.090992 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2695ae64f6d4b5ab81fe9e234025ca7" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:08.091655 28658 ts_tablet_manager.cc:1950] T 69d6c21b845649ac81e0b98eacaf6fff P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:08.091831 28207 raft_consensus.cc:3060] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:08.096472 28434 leader_election.cc:343] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: b2695ae64f6d4b5ab81fe9e234025ca7
I20260928 07:56:08.097527 28782 leader_election.cc:290] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:08.100999 28666 ts_tablet_manager.cc:1434] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.059s user 0.008s sys 0.000s
I20260928 07:56:08.102239 28666 tablet_bootstrap.cc:492] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:08.110590 28205 raft_consensus.cc:2468] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
W20260928 07:56:08.110664 28434 consensus_peers.cc:597] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e -> Peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Couldn't send request to peer 3bd67de620c94af3b7c8e3ba7d42f980. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b14ce2207154262a8a6b4d7b7e1e137. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:08.110893 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 69d6c21b845649ac81e0b98eacaf6fff (table default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]) successfully deleted
I20260928 07:56:08.109006 28350 raft_consensus.cc:2468] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:08.114464 28434 leader_election.cc:304] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:08.116418 28662 tablet_bootstrap.cc:654] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.116786 28207 raft_consensus.cc:2468] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:08.120710 27822 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:08.121726 28658 tablet_replica.cc:333] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:08.122473 28658 raft_consensus.cc:2243] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:08.123298 28658 pending_rounds.cc:70] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Trying to abort 1 pending ops.
I20260928 07:56:08.123510 28658 pending_rounds.cc:77] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224556134166528 op_type: NO_OP noop_request { }
I20260928 07:56:08.123831 28658 raft_consensus.cc:2889] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:08.124158 28658 raft_consensus.cc:2272] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.128392 28666 tablet_bootstrap.cc:654] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.131922 28434 leader_election.cc:304] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:08.132934 28782 raft_consensus.cc:2804] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:08.133579 28849 raft_consensus.cc:2804] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:08.133985 28849 raft_consensus.cc:697] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:08.134805 28849 consensus_queue.cc:237] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.137460 28887 tablet.cc:1751] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 07:56:08.138388 28782 raft_consensus.cc:697] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:08.139333 28782 consensus_queue.cc:237] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.144815 28892 tablet.cc:1751] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 07:56:08.131534 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 6e11d567741f4acd9c9a3498493c6776
I20260928 07:56:08.139479 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:08.160944 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e11d567741f4acd9c9a3498493c6776 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f0480f5920b4ffc8592407417d42d92) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:08.164386 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 6e11d567741f4acd9c9a3498493c6776 deleted and replaced by tablet 3f0480f5920b4ffc8592407417d42d92
I20260928 07:56:08.169451 28886 tablet.cc:1746] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Skipping requested alter to schema version 2, tablet already version 2
I20260928 07:56:08.142066 28657 tablet_replica.cc:333] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:08.163050 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e11d567741f4acd9c9a3498493c6776 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f0480f5920b4ffc8592407417d42d92) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:08.189844 28657 raft_consensus.cc:2243] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.190415 28657 raft_consensus.cc:2272] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.192199 28657 ts_tablet_manager.cc:1916] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.156605 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet b2695ae64f6d4b5ab81fe9e234025ca7 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e11d567741f4acd9c9a3498493c6776) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:08.179559 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e11d567741f4acd9c9a3498493c6776 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f0480f5920b4ffc8592407417d42d92) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:08.202737 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0480f5920b4ffc8592407417d42d92 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.202719 28849 raft_consensus.cc:493] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:08.205753 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0480f5920b4ffc8592407417d42d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.205938 28849 raft_consensus.cc:515] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.208123 28662 tablet_bootstrap.cc:492] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:08.208638 28849 leader_election.cc:290] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:08.211018 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa47d4f3bbb45f89a1750e512614b98" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:08.211719 28207 raft_consensus.cc:2468] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:08.213076 28434 leader_election.cc:304] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:08.214496 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa47d4f3bbb45f89a1750e512614b98" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:08.215646 28351 raft_consensus.cc:2468] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:08.217563 28849 raft_consensus.cc:2804] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:08.217979 28849 raft_consensus.cc:493] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:08.218369 28849 raft_consensus.cc:3060] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.209281 28662 ts_tablet_manager.cc:1403] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.196s user 0.013s sys 0.000s
I20260928 07:56:08.225571 28667 tablet_bootstrap.cc:492] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:08.226559 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet c682ee6d2eaf4bd3902e35b9bec3db0d from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:08.236567 28662 raft_consensus.cc:359] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.241586 28662 raft_consensus.cc:385] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.245708 28662 raft_consensus.cc:740] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
W20260928 07:56:08.248941 27815 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.AlterSchema -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 76392.1us
I20260928 07:56:08.249738 28662 consensus_queue.cc:260] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.251227 28667 tablet_bootstrap.cc:654] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.252148 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0480f5920b4ffc8592407417d42d92 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.253377 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0480f5920b4ffc8592407417d42d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.258788 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0480f5920b4ffc8592407417d42d92 (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.270807 28662 ts_tablet_manager.cc:1434] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.048s user 0.008s sys 0.002s
I20260928 07:56:08.282815 28662 tablet_bootstrap.cc:492] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:08.204514 28658 ts_tablet_manager.cc:1916] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.287026 27820 catalog_manager.cc:6391] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed] alter complete (version 2)
I20260928 07:56:08.288386 28667 tablet_bootstrap.cc:492] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:08.288827 28667 ts_tablet_manager.cc:1403] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.063s user 0.008s sys 0.001s
I20260928 07:56:08.289757 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet c682ee6d2eaf4bd3902e35b9bec3db0d
I20260928 07:56:08.291445 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet c682ee6d2eaf4bd3902e35b9bec3db0d with delete_type TABLET_DATA_DELETED (replaced by tablet 532be147761546ecb660b4451018e1e1) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:08.291313 28667 raft_consensus.cc:359] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.291934 28667 raft_consensus.cc:385] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.292220 28667 raft_consensus.cc:740] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.293533 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet c682ee6d2eaf4bd3902e35b9bec3db0d with delete_type TABLET_DATA_DELETED (replaced by tablet 532be147761546ecb660b4451018e1e1) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:08.296068 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0480f5920b4ffc8592407417d42d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.297297 27822 catalog_manager.cc:6934] ReplaceTablet: tablet c682ee6d2eaf4bd3902e35b9bec3db0d deleted and replaced by tablet 532be147761546ecb660b4451018e1e1
I20260928 07:56:08.298975 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet c682ee6d2eaf4bd3902e35b9bec3db0d with delete_type TABLET_DATA_DELETED (replaced by tablet 532be147761546ecb660b4451018e1e1) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:08.299916 28846 raft_consensus.cc:493] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:08.300439 28846 raft_consensus.cc:515] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.301079 28656 ts_tablet_manager.cc:1929] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.301461 28656 log.cc:1199] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/2b14ce2207154262a8a6b4d7b7e1e137
I20260928 07:56:08.303916 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e11d567741f4acd9c9a3498493c6776" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:08.304286 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e11d567741f4acd9c9a3498493c6776" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:08.304913 28351 raft_consensus.cc:2468] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
W20260928 07:56:08.305154 28141 leader_election.cc:343] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:08.302511 28846 leader_election.cc:290] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:08.307199 28142 leader_election.cc:304] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:08.309309 28666 tablet_bootstrap.cc:492] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:08.308992 28846 raft_consensus.cc:2804] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:08.309602 28846 raft_consensus.cc:493] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:08.309824 28666 ts_tablet_manager.cc:1403] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.208s user 0.003s sys 0.008s
I20260928 07:56:08.310150 28846 raft_consensus.cc:3060] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.312355 28666 raft_consensus.cc:359] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.312970 28666 raft_consensus.cc:385] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.313261 28666 raft_consensus.cc:740] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.313936 28666 consensus_queue.cc:260] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.314772 28656 ts_tablet_manager.cc:1950] T 2b14ce2207154262a8a6b4d7b7e1e137 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:08.317411 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:08.292881 28667 consensus_queue.cc:260] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.326225 28667 ts_tablet_manager.cc:1434] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.037s user 0.004s sys 0.004s
I20260928 07:56:08.327024 28656 tablet_replica.cc:333] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:08.328025 28656 raft_consensus.cc:2243] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.329867 28656 raft_consensus.cc:2272] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.330523 28666 ts_tablet_manager.cc:1434] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260928 07:56:08.332281 28656 ts_tablet_manager.cc:1916] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.333384 28666 tablet_bootstrap.cc:492] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:08.334954 27820 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:08.343986 28800 consensus_queue.cc:1048] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:08.343369 28666 tablet_bootstrap.cc:654] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.327286 28846 raft_consensus.cc:515] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.358224 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e11d567741f4acd9c9a3498493c6776" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:08.358843 28351 raft_consensus.cc:3060] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.362668 28667 tablet_bootstrap.cc:492] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:08.372027 28667 tablet_bootstrap.cc:654] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.371968 28351 raft_consensus.cc:2468] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:08.373555 28142 leader_election.cc:304] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:08.374445 28800 raft_consensus.cc:2804] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:08.352756 28849 raft_consensus.cc:515] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.383944 28887 tablet.cc:1746] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Skipping requested alter to schema version 2, tablet already version 2
I20260928 07:56:08.386102 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa47d4f3bbb45f89a1750e512614b98" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:08.386554 28900 tablet.cc:1746] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Skipping requested alter to schema version 2, tablet already version 2
I20260928 07:56:08.386693 28207 raft_consensus.cc:3060] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.345063 28662 tablet_bootstrap.cc:654] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.395499 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e11d567741f4acd9c9a3498493c6776" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:08.395684 28207 raft_consensus.cc:2468] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:08.396123 28498 raft_consensus.cc:3060] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.396881 28434 leader_election.cc:304] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:08.397710 28782 raft_consensus.cc:2804] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:08.398106 28846 leader_election.cc:290] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:08.398141 28782 raft_consensus.cc:697] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:08.398986 28782 consensus_queue.cc:237] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.403339 28498 raft_consensus.cc:2468] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:08.404644 28800 raft_consensus.cc:697] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:08.405799 28800 consensus_queue.cc:237] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.415828 28658 ts_tablet_manager.cc:1929] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:08.416850 28662 tablet_bootstrap.cc:492] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:08.417261 28662 ts_tablet_manager.cc:1403] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.136s user 0.011s sys 0.001s
I20260928 07:56:08.419179 28658 log.cc:1199] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/2b14ce2207154262a8a6b4d7b7e1e137
I20260928 07:56:08.419044 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa47d4f3bbb45f89a1750e512614b98" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:08.419694 28351 raft_consensus.cc:3060] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.420899 28656 ts_tablet_manager.cc:1929] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.421273 28656 log.cc:1199] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/69d6c21b845649ac81e0b98eacaf6fff
I20260928 07:56:08.421905 28656 ts_tablet_manager.cc:1950] T 69d6c21b845649ac81e0b98eacaf6fff P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:08.423739 28658 ts_tablet_manager.cc:1950] T 2b14ce2207154262a8a6b4d7b7e1e137 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:08.427099 28875 raft_consensus.cc:493] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:08.427543 28875 raft_consensus.cc:515] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.429925 28875 leader_election.cc:290] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:08.422607 28898 consensus_queue.cc:1048] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:08.433689 28662 raft_consensus.cc:359] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.434372 28662 raft_consensus.cc:385] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.434631 28662 raft_consensus.cc:740] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.432343 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9220066aaeb4417a73707bd5679846f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:08.444211 28286 leader_election.cc:343] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:08.446645 28662 consensus_queue.cc:260] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.452581 28658 tablet_replica.cc:333] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:08.456816 28662 ts_tablet_manager.cc:1434] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260928 07:56:08.458050 28662 tablet_bootstrap.cc:492] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:08.463498 28662 tablet_bootstrap.cc:654] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.469964 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 69d6c21b845649ac81e0b98eacaf6fff (table default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]) successfully deleted
I20260928 07:56:08.473258 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 532be147761546ecb660b4451018e1e1 (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.474265 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532be147761546ecb660b4451018e1e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.475661 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 532be147761546ecb660b4451018e1e1 (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.477721 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532be147761546ecb660b4451018e1e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.478864 28656 tablet_replica.cc:333] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:08.479636 28656 raft_consensus.cc:2243] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.480072 28656 raft_consensus.cc:2272] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.473117 28658 raft_consensus.cc:2243] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.482715 28351 raft_consensus.cc:2468] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:08.483626 28658 raft_consensus.cc:2272] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.491261 28656 ts_tablet_manager.cc:1916] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.498055 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:08.499095 28667 tablet_bootstrap.cc:492] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:08.499648 28667 ts_tablet_manager.cc:1403] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.137s user 0.011s sys 0.013s
I20260928 07:56:08.502790 28662 tablet_bootstrap.cc:492] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:08.503204 28662 ts_tablet_manager.cc:1403] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.045s user 0.009s sys 0.001s
I20260928 07:56:08.506119 28658 ts_tablet_manager.cc:1916] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.505931 28662 raft_consensus.cc:359] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.506557 28662 raft_consensus.cc:385] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.506824 28662 raft_consensus.cc:740] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.507442 28662 consensus_queue.cc:260] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.506974 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9220066aaeb4417a73707bd5679846f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:08.515666 28285 leader_election.cc:343] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:08.516126 28285 leader_election.cc:304] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:08.517551 28875 raft_consensus.cc:2749] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:08.517817 28662 ts_tablet_manager.cc:1434] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260928 07:56:08.498219 28849 leader_election.cc:290] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
W20260928 07:56:08.522642 28903 log.cc:927] Time spent T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
I20260928 07:56:08.525998 28662 tablet_bootstrap.cc:492] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:08.524487 28666 tablet_bootstrap.cc:492] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:08.530138 28666 ts_tablet_manager.cc:1403] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.197s user 0.009s sys 0.016s
I20260928 07:56:08.531618 28662 tablet_bootstrap.cc:654] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.532714 28666 raft_consensus.cc:359] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.537923 28898 consensus_queue.cc:1048] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:08.540380 28667 raft_consensus.cc:359] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.541020 28667 raft_consensus.cc:385] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.541304 28667 raft_consensus.cc:740] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.543120 28666 raft_consensus.cc:385] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.543431 28666 raft_consensus.cc:740] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.544209 28666 consensus_queue.cc:260] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.561250 28800 consensus_queue.cc:1048] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:08.556247 28667 consensus_queue.cc:260] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.577358 28666 ts_tablet_manager.cc:1434] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
I20260928 07:56:08.585727 28875 raft_consensus.cc:493] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:08.586258 28875 raft_consensus.cc:515] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.588541 28875 leader_election.cc:290] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:08.592052 28657 ts_tablet_manager.cc:1929] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.594522 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 532be147761546ecb660b4451018e1e1 (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.595640 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532be147761546ecb660b4451018e1e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.597453 28666 tablet_bootstrap.cc:492] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:08.601274 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad8656a1c06494b9ebc9eb2e9512b41" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:08.608127 28666 tablet_bootstrap.cc:654] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.612644 28658 ts_tablet_manager.cc:1929] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.613004 28658 log.cc:1199] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/1e0e52acb3084a78b0a50a6013d7a984
I20260928 07:56:08.613660 28658 ts_tablet_manager.cc:1950] T 1e0e52acb3084a78b0a50a6013d7a984 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:08.609162 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad8656a1c06494b9ebc9eb2e9512b41" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:08.615728 28662 tablet_bootstrap.cc:492] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:08.616070 28656 ts_tablet_manager.cc:1929] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.616159 28662 ts_tablet_manager.cc:1403] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.090s user 0.016s sys 0.016s
I20260928 07:56:08.616169 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 1e0e52acb3084a78b0a50a6013d7a984 (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:08.616446 28656 log.cc:1199] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/4b2bb4f4268e42dabc8afe88f41a8daf
I20260928 07:56:08.617100 28656 ts_tablet_manager.cc:1950] T 4b2bb4f4268e42dabc8afe88f41a8daf P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:08.618814 28662 raft_consensus.cc:359] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.619482 28662 raft_consensus.cc:385] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.619815 28662 raft_consensus.cc:740] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.620560 28662 consensus_queue.cc:260] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.622422 28662 ts_tablet_manager.cc:1434] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260928 07:56:08.623251 28662 tablet_bootstrap.cc:492] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
W20260928 07:56:08.616456 28910 log.cc:927] Time spent T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: Append to log took a long time: real 0.059s user 0.001s sys 0.000s
I20260928 07:56:08.625654 28658 tablet_replica.cc:333] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:08.626400 28658 raft_consensus.cc:2243] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.626883 28658 raft_consensus.cc:2272] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.631570 28658 ts_tablet_manager.cc:1916] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.638018 28662 tablet_bootstrap.cc:654] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.644479 27820 catalog_manager.cc:5838] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:08.656133 28662 tablet_bootstrap.cc:492] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:08.656556 28662 ts_tablet_manager.cc:1403] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.007s
I20260928 07:56:08.592907 28667 ts_tablet_manager.cc:1434] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.093s user 0.006s sys 0.000s
I20260928 07:56:08.658890 28657 log.cc:1199] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/4b2bb4f4268e42dabc8afe88f41a8daf
I20260928 07:56:08.659560 28667 tablet_bootstrap.cc:492] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:08.659698 28657 ts_tablet_manager.cc:1950] T 4b2bb4f4268e42dabc8afe88f41a8daf P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:08.662209 28662 raft_consensus.cc:359] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.662846 28662 raft_consensus.cc:385] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.663092 28662 raft_consensus.cc:740] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.664914 28846 raft_consensus.cc:493] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 07:56:08.605396 28285 leader_election.cc:343] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:08.665843 28285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 60484us
I20260928 07:56:08.665508 28846 raft_consensus.cc:515] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:08.666821 28286 leader_election.cc:343] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:08.667675 28846 leader_election.cc:290] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:08.667716 28286 leader_election.cc:304] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:08.668318 28656 tablet_replica.cc:333] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
W20260928 07:56:08.668637 28286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 52839.2us
I20260928 07:56:08.669059 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 4b2bb4f4268e42dabc8afe88f41a8daf (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:08.670550 28914 raft_consensus.cc:2749] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:08.670670 28662 consensus_queue.cc:260] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.671271 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682ee6d2eaf4bd3902e35b9bec3db0d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:08.671836 28349 raft_consensus.cc:2468] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:08.672339 28657 tablet_replica.cc:333] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:08.672652 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 4b2bb4f4268e42dabc8afe88f41a8daf (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:08.673569 28142 leader_election.cc:304] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:08.669863 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682ee6d2eaf4bd3902e35b9bec3db0d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:08.675655 28141 leader_election.cc:343] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:08.676123 28089 hms_client.cc:335] Time spent create HMS table: real 1.087s user 0.000s sys 0.000s
I20260928 07:56:08.676455 28656 raft_consensus.cc:2243] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.676609 27821 catalog_manager.cc:2213] created HMS catalog entry for table [id=069e22d7ef5d43e1b5e323608df44264]
I20260928 07:56:08.676904 28656 raft_consensus.cc:2272] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.673314 28667 tablet_bootstrap.cc:654] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.681461 28657 raft_consensus.cc:2243] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.681978 28657 raft_consensus.cc:2272] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.683780 28657 ts_tablet_manager.cc:1916] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.686371 28666 tablet_bootstrap.cc:492] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:08.686841 28666 ts_tablet_manager.cc:1403] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.109s user 0.009s sys 0.010s
I20260928 07:56:08.693751 28666 raft_consensus.cc:359] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.694396 28666 raft_consensus.cc:385] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.694633 28666 raft_consensus.cc:740] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.699915 28914 raft_consensus.cc:493] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:08.700376 28914 raft_consensus.cc:515] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.702525 28914 leader_election.cc:290] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:08.707789 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d29eed5714db597516c573326153c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:08.709515 28285 leader_election.cc:343] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:08.710901 28667 tablet_bootstrap.cc:492] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:08.711402 28667 ts_tablet_manager.cc:1403] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.052s user 0.013s sys 0.000s
I20260928 07:56:08.713991 28667 raft_consensus.cc:359] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.714538 27821 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 67) took 2360 ms. Trace:
I20260928 07:56:08.717358 28667 raft_consensus.cc:385] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.717638 28667 raft_consensus.cc:740] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.721622 28658 ts_tablet_manager.cc:1929] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.721997 28658 log.cc:1199] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/4b2bb4f4268e42dabc8afe88f41a8daf
I20260928 07:56:08.722609 28658 ts_tablet_manager.cc:1950] T 4b2bb4f4268e42dabc8afe88f41a8daf P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:08.724993 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 4b2bb4f4268e42dabc8afe88f41a8daf (table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:08.714844 27821 rpcz_store.cc:276] 0928 07:56:06.354572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:06.356483 (+ 1911us) service_pool.cc:224] Handling call
0928 07:56:06.431196 (+ 74713us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:06.437013 (+ 5817us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:08.676566 (+2239553us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:08.713806 (+ 37240us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:08.714172 (+ 366us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:08.714475 (+ 303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:08.689713 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:08.690125 (+ 412us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:08.690150 (+ 25us) write_op.cc:435] Acquired schema lock
0928 07:56:08.690163 (+ 13us) tablet.cc:662] Decoding operations
0928 07:56:08.690446 (+ 283us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:08.690485 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:08.690509 (+ 24us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:08.690719 (+ 210us) tablet.cc:701] Row locks acquired
0928 07:56:08.690733 (+ 14us) write_op.cc:260] PREPARE: finished
0928 07:56:08.697715 (+ 6982us) write_op.cc:270] Start()
0928 07:56:08.697803 (+ 88us) write_op.cc:276] Timestamp: P: 1790582168697644 usec, L: 0
0928 07:56:08.697818 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:08.698274 (+ 456us) log.cc:844] Serialized 432 byte log entry
0928 07:56:08.711327 (+ 13053us) op_driver.cc:464] REPLICATION: finished
0928 07:56:08.711767 (+ 440us) write_op.cc:301] APPLY: starting
0928 07:56:08.711819 (+ 52us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:08.711940 (+ 121us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:08.712054 (+ 114us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:08.712501 (+ 447us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:08.712635 (+ 134us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:08.712680 (+ 45us) write_op.cc:312] APPLY: finished
0928 07:56:08.712866 (+ 186us) log.cc:844] Serialized 28 byte log entry
0928 07:56:08.713014 (+ 148us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:08.713083 (+ 69us) write_op.cc:454] Released schema lock
0928 07:56:08.713115 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:08.713388 (+ 273us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:08.713410 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1151299,"Hive Metastore.run_cpu_time_us":886,"Hive Metastore.run_wall_time_us":1087663,"child_traces":[["op",{"apply.queue_time_us":282,"apply.run_cpu_time_us":1587,"apply.run_wall_time_us":1587,"mutex_wait_us":11446,"num_ops":2,"prepare.queue_time_us":11611,"prepare.run_cpu_time_us":2006,"prepare.run_wall_time_us":9010,"raft.queue_time_us":84,"raft.run_cpu_time_us":15,"raft.run_wall_time_us":17,"replication_time_us":13422}]]}
I20260928 07:56:08.726667 28667 consensus_queue.cc:260] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.725891 28666 consensus_queue.cc:260] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.714628 28657 ts_tablet_manager.cc:1929] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.730528 28657 log.cc:1199] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/6e11d567741f4acd9c9a3498493c6776
I20260928 07:56:08.731268 28657 ts_tablet_manager.cc:1950] T 6e11d567741f4acd9c9a3498493c6776 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:08.733803 28666 ts_tablet_manager.cc:1434] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.047s user 0.006s sys 0.001s
I20260928 07:56:08.677147 28846 raft_consensus.cc:2804] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:08.680613 28662 ts_tablet_manager.cc:1434] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260928 07:56:08.734241 28846 raft_consensus.cc:493] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:08.734617 28846 raft_consensus.cc:3060] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.734879 28662 tablet_bootstrap.cc:492] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:08.705058 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d29eed5714db597516c573326153c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:08.737540 28667 ts_tablet_manager.cc:1434] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20260928 07:56:08.737485 28207 raft_consensus.cc:2468] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:08.742897 28666 tablet_bootstrap.cc:492] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:08.744318 28846 raft_consensus.cc:515] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.745941 28286 leader_election.cc:304] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:08.747044 28914 raft_consensus.cc:2804] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:08.747375 28914 raft_consensus.cc:493] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:08.747668 28914 raft_consensus.cc:3060] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.749753 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682ee6d2eaf4bd3902e35b9bec3db0d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:08.750277 28349 raft_consensus.cc:3060] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.750695 28666 tablet_bootstrap.cc:654] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.756944 28658 tablet_replica.cc:333] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:08.757704 28658 raft_consensus.cc:2243] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:08.760375 28349 raft_consensus.cc:2468] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:08.760605 28658 pending_rounds.cc:70] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Trying to abort 1 pending ops.
I20260928 07:56:08.760730 28662 tablet_bootstrap.cc:654] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.760841 28658 pending_rounds.cc:77] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224560689561600 op_type: NO_OP noop_request { }
I20260928 07:56:08.761173 28658 raft_consensus.cc:2889] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:08.761525 28658 raft_consensus.cc:2272] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.761838 28142 leader_election.cc:304] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:08.762660 28898 raft_consensus.cc:2804] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:08.763073 28898 raft_consensus.cc:697] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:08.763819 28898 consensus_queue.cc:237] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.764595 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 6e11d567741f4acd9c9a3498493c6776 (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:08.765242 28914 raft_consensus.cc:515] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.767818 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d29eed5714db597516c573326153c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:08.768348 28207 raft_consensus.cc:3060] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.771274 28658 ts_tablet_manager.cc:1916] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.775928 28207 raft_consensus.cc:2468] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:08.777207 28657 tablet_replica.cc:333] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:08.778556 28657 raft_consensus.cc:2243] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.783718 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d29eed5714db597516c573326153c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:08.785262 28285 leader_election.cc:343] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:08.786465 28657 raft_consensus.cc:2272] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.787613 28286 leader_election.cc:304] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:08.788535 28875 raft_consensus.cc:2804] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:08.785722 28914 leader_election.cc:290] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:08.799083 28657 ts_tablet_manager.cc:1916] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.799631 28666 tablet_bootstrap.cc:492] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:08.800127 28666 ts_tablet_manager.cc:1403] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.005s
I20260928 07:56:08.806042 28666 raft_consensus.cc:359] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.802683 28875 raft_consensus.cc:697] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:08.806790 28666 raft_consensus.cc:385] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.807080 28666 raft_consensus.cc:740] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.807919 28875 consensus_queue.cc:237] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.810153 28666 consensus_queue.cc:260] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.820077 28662 tablet_bootstrap.cc:492] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:08.820720 28662 ts_tablet_manager.cc:1403] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.086s user 0.004s sys 0.008s
I20260928 07:56:08.820819 28846 leader_election.cc:290] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:08.823974 28662 raft_consensus.cc:359] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.831797 28662 raft_consensus.cc:385] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.832191 28662 raft_consensus.cc:740] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.833482 28662 consensus_queue.cc:260] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.821951 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682ee6d2eaf4bd3902e35b9bec3db0d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:08.842077 28499 raft_consensus.cc:3060] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:08.845721 28667 tablet_bootstrap.cc:492] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:08.839795 28656 ts_tablet_manager.cc:1916] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.830933 28666 ts_tablet_manager.cc:1434] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.030s user 0.006s sys 0.001s
I20260928 07:56:08.846321 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:08.853693 28662 ts_tablet_manager.cc:1434] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20260928 07:56:08.855674 28662 tablet_bootstrap.cc:492] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
W20260928 07:56:08.856209 27814 catalog_manager.cc:5136] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): alter failed for tablet 2b14ce2207154262a8a6b4d7b7e1e137 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]),no further retry: Not found: Tablet not found: 2b14ce2207154262a8a6b4d7b7e1e137
I20260928 07:56:08.856827 28666 tablet_bootstrap.cc:492] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:08.861153 28667 tablet_bootstrap.cc:654] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.864197 28657 ts_tablet_manager.cc:1929] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.863415 27821 catalog_manager.cc:5838] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:08.872821 28662 tablet_bootstrap.cc:654] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.873167 28499 raft_consensus.cc:2468] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:08.874521 28478 tablet_service.cc:1511] Processing CreateTablet for tablet a3d9dd8311614adc8408685fa409e44f (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.875837 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d9dd8311614adc8408685fa409e44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.878439 28666 tablet_bootstrap.cc:654] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.819824 28658 ts_tablet_manager.cc:1929] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:08.884975 28658 log.cc:1199] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/b2695ae64f6d4b5ab81fe9e234025ca7
I20260928 07:56:08.885682 28658 ts_tablet_manager.cc:1950] T b2695ae64f6d4b5ab81fe9e234025ca7 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:08.888051 28185 tablet_service.cc:1511] Processing CreateTablet for tablet a3d9dd8311614adc8408685fa409e44f (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.889154 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d9dd8311614adc8408685fa409e44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.891913 28658 tablet_replica.cc:333] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:08.892603 28658 raft_consensus.cc:2243] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:08.893035 28658 raft_consensus.cc:2272] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.897440 28657 log.cc:1199] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/c682ee6d2eaf4bd3902e35b9bec3db0d
I20260928 07:56:08.898239 28666 tablet_bootstrap.cc:492] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:08.896030 28667 tablet_bootstrap.cc:492] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:08.891331 28329 tablet_service.cc:1511] Processing CreateTablet for tablet a3d9dd8311614adc8408685fa409e44f (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:08.898928 28667 ts_tablet_manager.cc:1403] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.053s user 0.011s sys 0.000s
I20260928 07:56:08.899436 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d9dd8311614adc8408685fa409e44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:08.888216 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet b2695ae64f6d4b5ab81fe9e234025ca7 (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:08.905064 28666 ts_tablet_manager.cc:1403] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.048s user 0.010s sys 0.000s
I20260928 07:56:08.901504 28667 raft_consensus.cc:359] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.906153 28667 raft_consensus.cc:385] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.906424 28667 raft_consensus.cc:740] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.898270 28657 ts_tablet_manager.cc:1950] T c682ee6d2eaf4bd3902e35b9bec3db0d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:08.909473 28658 ts_tablet_manager.cc:1916] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.915834 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet c682ee6d2eaf4bd3902e35b9bec3db0d (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:08.917501 28667 consensus_queue.cc:260] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.929764 28656 ts_tablet_manager.cc:1929] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.932456 28667 ts_tablet_manager.cc:1434] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260928 07:56:08.933024 28656 log.cc:1199] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/b2695ae64f6d4b5ab81fe9e234025ca7
I20260928 07:56:08.933967 28656 ts_tablet_manager.cc:1950] T b2695ae64f6d4b5ab81fe9e234025ca7 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:08.909133 28666 raft_consensus.cc:359] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.935420 28666 raft_consensus.cc:385] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.935690 28666 raft_consensus.cc:740] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.936156 28662 tablet_bootstrap.cc:492] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:08.936672 28662 ts_tablet_manager.cc:1403] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.081s user 0.011s sys 0.000s
I20260928 07:56:08.938143 28666 consensus_queue.cc:260] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:08.936277 28656 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54230 (request call id 104) took 1186 ms. Trace:
I20260928 07:56:08.941311 28656 rpcz_store.cc:276] 0928 07:56:07.750223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:07.877519 (+127296us) service_pool.cc:224] Handling call
0928 07:56:08.668133 (+790614us) ts_tablet_manager.cc:1151] Deleting tablet b2695ae64f6d4b5ab81fe9e234025ca7
0928 07:56:08.668195 (+ 62us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:08.867741 (+199546us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:08.929610 (+ 61869us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:08.936222 (+ 6612us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":789611}
I20260928 07:56:08.943281 28662 raft_consensus.cc:359] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.943928 28662 raft_consensus.cc:385] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:08.944039 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet b2695ae64f6d4b5ab81fe9e234025ca7 (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:08.944175 28662 raft_consensus.cc:740] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:08.944772 28662 consensus_queue.cc:260] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:08.950109 28666 ts_tablet_manager.cc:1434] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.043s user 0.005s sys 0.000s
I20260928 07:56:08.950407 28662 ts_tablet_manager.cc:1434] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.013s user 0.002s sys 0.003s
I20260928 07:56:08.951180 28662 tablet_bootstrap.cc:492] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:08.958213 28666 tablet_bootstrap.cc:492] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:08.961755 28656 tablet_replica.cc:333] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:08.962579 28656 raft_consensus.cc:2243] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:08.966632 28656 pending_rounds.cc:70] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:08.967294 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:08.970527 28667 tablet_bootstrap.cc:492] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:08.978729 28656 pending_rounds.cc:77] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224561802027008 op_type: NO_OP noop_request { }
I20260928 07:56:08.978972 28667 tablet_bootstrap.cc:654] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.979305 28656 raft_consensus.cc:2889] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:08.979725 28656 raft_consensus.cc:2272] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:08.981948 28656 ts_tablet_manager.cc:1916] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:08.990536 28662 tablet_bootstrap.cc:654] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.991212 28666 tablet_bootstrap.cc:654] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:08.991248 27820 catalog_manager.cc:5838] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:08.996377 28658 ts_tablet_manager.cc:1929] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:08.996819 28658 log.cc:1199] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/6e11d567741f4acd9c9a3498493c6776
I20260928 07:56:08.997601 28658 ts_tablet_manager.cc:1950] T 6e11d567741f4acd9c9a3498493c6776 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:09.010054 28666 tablet_bootstrap.cc:492] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:09.010541 28666 ts_tablet_manager.cc:1403] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.000s
I20260928 07:56:09.016247 28875 raft_consensus.cc:493] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.016892 28875 raft_consensus.cc:515] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.017750 28658 tablet_replica.cc:333] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:09.018483 28658 raft_consensus.cc:2243] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:09.018663 28662 tablet_bootstrap.cc:492] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:09.018918 28658 raft_consensus.cc:2272] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.018996 28875 leader_election.cc:290] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:09.019090 28662 ts_tablet_manager.cc:1403] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.068s user 0.008s sys 0.002s
I20260928 07:56:09.021612 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 6e11d567741f4acd9c9a3498493c6776 (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:09.023454 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0480f5920b4ffc8592407417d42d92" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:09.026172 28666 raft_consensus.cc:359] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.026738 28656 ts_tablet_manager.cc:1929] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:09.026830 28666 raft_consensus.cc:385] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.027070 28656 log.cc:1199] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/6e11d567741f4acd9c9a3498493c6776
I20260928 07:56:09.027087 28666 raft_consensus.cc:740] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.027743 28656 ts_tablet_manager.cc:1950] T 6e11d567741f4acd9c9a3498493c6776 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:09.029405 28658 ts_tablet_manager.cc:1916] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:09.029520 28286 leader_election.cc:343] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:09.030462 28656 tablet_replica.cc:333] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:09.030613 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 6e11d567741f4acd9c9a3498493c6776 (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:09.031337 28656 raft_consensus.cc:2243] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:09.031937 28656 pending_rounds.cc:70] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:09.032137 28656 pending_rounds.cc:77] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224563269214208 op_type: NO_OP noop_request { }
I20260928 07:56:09.032444 28656 raft_consensus.cc:2889] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:09.032375 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0480f5920b4ffc8592407417d42d92" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:09.032209 28849 consensus_queue.cc:1048] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:09.032729 28656 raft_consensus.cc:2272] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.035303 28656 ts_tablet_manager.cc:1916] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:09.037308 28285 leader_election.cc:343] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:09.037720 28285 leader_election.cc:304] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:09.038753 28662 raft_consensus.cc:359] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.039479 28662 raft_consensus.cc:385] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.039743 28662 raft_consensus.cc:740] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.040685 28921 raft_consensus.cc:2749] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:09.033402 28666 consensus_queue.cc:260] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.053332 28662 consensus_queue.cc:260] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.064476 28662 ts_tablet_manager.cc:1434] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.045s user 0.006s sys 0.001s
I20260928 07:56:09.068790 28666 ts_tablet_manager.cc:1434] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.058s user 0.006s sys 0.002s
I20260928 07:56:08.993063 27820 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:09.081286 28667 tablet_bootstrap.cc:492] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:09.082056 28667 ts_tablet_manager.cc:1403] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.112s user 0.002s sys 0.017s
I20260928 07:56:09.086851 28666 tablet_bootstrap.cc:492] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:09.092284 28666 tablet_bootstrap.cc:654] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.096424 28662 tablet_bootstrap.cc:492] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:09.101747 28656 ts_tablet_manager.cc:1929] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:09.103204 28656 log.cc:1199] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/c682ee6d2eaf4bd3902e35b9bec3db0d
I20260928 07:56:09.104578 28656 ts_tablet_manager.cc:1950] T c682ee6d2eaf4bd3902e35b9bec3db0d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:09.117420 28849 raft_consensus.cc:493] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.118494 28849 raft_consensus.cc:515] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.118949 28937 consensus_queue.cc:1048] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:09.120859 28849 leader_election.cc:290] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.121785 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9220066aaeb4417a73707bd5679846f" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:09.122366 28205 raft_consensus.cc:2468] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:09.125373 28434 leader_election.cc:304] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:09.126060 28930 raft_consensus.cc:2804] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:09.126415 28930 raft_consensus.cc:493] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:09.126788 28930 raft_consensus.cc:3060] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.108803 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet c682ee6d2eaf4bd3902e35b9bec3db0d (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:09.128197 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9220066aaeb4417a73707bd5679846f" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:09.129083 28349 raft_consensus.cc:2468] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:09.133553 28930 raft_consensus.cc:515] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.134179 28875 raft_consensus.cc:493] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.134765 28875 raft_consensus.cc:515] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.135902 28666 tablet_bootstrap.cc:492] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:09.135999 27822 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:09.136479 28666 ts_tablet_manager.cc:1403] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.005s
I20260928 07:56:09.137068 28875 leader_election.cc:290] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:09.138644 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 69d6c21b845649ac81e0b98eacaf6fff from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:09.138636 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532be147761546ecb660b4451018e1e1" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:09.139954 28285 leader_election.cc:343] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:09.140947 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532be147761546ecb660b4451018e1e1" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:09.142247 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet c66d29eed5714db597516c573326153c from {username='slave'} at 127.0.0.1:51542
W20260928 07:56:09.143467 28286 leader_election.cc:343] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:09.143886 28286 leader_election.cc:304] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:09.145274 28875 raft_consensus.cc:2749] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:09.146862 28666 raft_consensus.cc:359] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.147605 28666 raft_consensus.cc:385] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.147928 28666 raft_consensus.cc:740] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.148693 28666 consensus_queue.cc:260] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.152380 28666 ts_tablet_manager.cc:1434] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260928 07:56:09.153577 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9220066aaeb4417a73707bd5679846f" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:09.154202 28207 raft_consensus.cc:3060] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.153900 28930 leader_election.cc:290] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.154482 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9220066aaeb4417a73707bd5679846f" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:09.155061 28349 raft_consensus.cc:3060] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.158881 28666 tablet_bootstrap.cc:492] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:09.158771 28846 raft_consensus.cc:493] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.159227 28846 raft_consensus.cc:515] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.160209 28662 tablet_bootstrap.cc:654] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.162278 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0480f5920b4ffc8592407417d42d92" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:09.163043 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0480f5920b4ffc8592407417d42d92" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:09.163625 28351 raft_consensus.cc:2468] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:09.164775 28142 leader_election.cc:304] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
W20260928 07:56:09.165479 28141 leader_election.cc:343] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:09.165638 28898 raft_consensus.cc:2804] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:09.165985 28898 raft_consensus.cc:493] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:09.161206 28846 leader_election.cc:290] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:09.166370 28898 raft_consensus.cc:3060] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.168437 28666 tablet_bootstrap.cc:654] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.175150 28349 raft_consensus.cc:2468] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:09.176551 28434 leader_election.cc:304] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:09.177521 28930 raft_consensus.cc:2804] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:09.177973 28930 raft_consensus.cc:697] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:09.177649 28667 raft_consensus.cc:359] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.178311 28667 raft_consensus.cc:385] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.178551 28667 raft_consensus.cc:740] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.178726 28930 consensus_queue.cc:237] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.179334 28667 consensus_queue.cc:260] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.196111 28898 raft_consensus.cc:515] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.199275 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0480f5920b4ffc8592407417d42d92" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:09.199337 28667 ts_tablet_manager.cc:1434] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.086s user 0.005s sys 0.000s
I20260928 07:56:09.200078 28349 raft_consensus.cc:3060] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.200532 28898 leader_election.cc:290] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:09.201676 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0480f5920b4ffc8592407417d42d92" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:09.203301 28141 leader_election.cc:343] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:09.206625 28207 raft_consensus.cc:2468] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:09.213068 28349 raft_consensus.cc:2468] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:09.214674 28142 leader_election.cc:304] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:09.226336 28898 raft_consensus.cc:2804] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:09.228060 28898 raft_consensus.cc:697] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:09.229008 28898 consensus_queue.cc:237] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.231596 28662 tablet_bootstrap.cc:492] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:09.232028 28662 ts_tablet_manager.cc:1403] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.136s user 0.005s sys 0.004s
I20260928 07:56:09.234822 28662 raft_consensus.cc:359] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.235435 28662 raft_consensus.cc:385] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.235692 28662 raft_consensus.cc:740] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.242942 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet c66d29eed5714db597516c573326153c
I20260928 07:56:09.245164 28930 raft_consensus.cc:493] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.245687 28930 raft_consensus.cc:515] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.247696 28930 leader_election.cc:290] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.248694 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet c66d29eed5714db597516c573326153c with delete_type TABLET_DATA_DELETED (replaced by tablet bd24ff6e06094b8c90e6b3fcf3d4f144) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:09.248833 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet c66d29eed5714db597516c573326153c with delete_type TABLET_DATA_DELETED (replaced by tablet bd24ff6e06094b8c90e6b3fcf3d4f144) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:09.249562 28656 tablet_replica.cc:333] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:09.250324 28656 raft_consensus.cc:2243] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:09.250765 28656 raft_consensus.cc:2272] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.250679 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet c66d29eed5714db597516c573326153c with delete_type TABLET_DATA_DELETED (replaced by tablet bd24ff6e06094b8c90e6b3fcf3d4f144) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:09.252117 28657 tablet_replica.cc:333] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:09.252444 28656 ts_tablet_manager.cc:1916] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.252841 28657 raft_consensus.cc:2243] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:09.253407 28657 pending_rounds.cc:70] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 2 pending ops.
I20260928 07:56:09.253613 28657 pending_rounds.cc:77] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7334224565237858304 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "c66d29eed5714db597516c573326153c" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.table_6ba15b125765407a97c61d226b03034e" dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" new_extra_config { } }
W20260928 07:56:09.254513 28657 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60428: Aborted: Op aborted
I20260928 07:56:09.255409 28657 pending_rounds.cc:77] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224563445497856 op_type: NO_OP noop_request { }
I20260928 07:56:09.256877 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e4db169e1644ad8ef3b248f2c4c586" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:09.257525 28349 raft_consensus.cc:2468] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:09.259791 28434 leader_election.cc:304] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:09.260951 28657 raft_consensus.cc:2889] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:09.262107 28499 raft_consensus.cc:3060] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:09.262604 27815 catalog_manager.cc:5142] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): alter failed for tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]): Aborted: Op aborted
I20260928 07:56:09.263260 28657 raft_consensus.cc:2272] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.260538 28930 raft_consensus.cc:2804] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:09.265697 28657 ts_tablet_manager.cc:1916] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.265944 28930 raft_consensus.cc:493] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:09.269650 28930 raft_consensus.cc:3060] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.245541 28662 consensus_queue.cc:260] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.275215 28662 ts_tablet_manager.cc:1434] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.043s user 0.006s sys 0.001s
I20260928 07:56:09.276072 28662 tablet_bootstrap.cc:492] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:09.285437 28499 raft_consensus.cc:1275] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Refusing update from remote peer 3bd67de620c94af3b7c8e3ba7d42f980: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:09.289582 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e4db169e1644ad8ef3b248f2c4c586" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:09.284930 28930 raft_consensus.cc:515] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.290879 28937 raft_consensus.cc:493] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.291352 28937 raft_consensus.cc:515] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.292987 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e4db169e1644ad8ef3b248f2c4c586" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:09.293458 28937 leader_election.cc:290] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.295032 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d29eed5714db597516c573326153c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:09.295657 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d1adb4f2f0dc4a86a2fffabf41436e4f consensus state has no leader
I20260928 07:56:09.296034 28662 tablet_bootstrap.cc:654] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.296137 27822 catalog_manager.cc:6934] ReplaceTablet: tablet c66d29eed5714db597516c573326153c deleted and replaced by tablet bd24ff6e06094b8c90e6b3fcf3d4f144
W20260928 07:56:09.296379 28434 leader_election.cc:343] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: Tablet not RUNNING: STOPPED
I20260928 07:56:09.292963 28207 raft_consensus.cc:2468] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:09.298463 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66d29eed5714db597516c573326153c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:09.299799 28434 leader_election.cc:343] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: Tablet not RUNNING: STOPPED
I20260928 07:56:09.300176 28434 leader_election.cc:304] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:09.300822 28937 raft_consensus.cc:2749] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 07:56:09.303812 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e4db169e1644ad8ef3b248f2c4c586" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:09.304314 28349 raft_consensus.cc:3060] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.304973 28930 leader_election.cc:290] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.310761 28349 raft_consensus.cc:2468] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:09.312000 28434 leader_election.cc:304] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:09.312842 28930 raft_consensus.cc:2804] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:09.316224 28930 raft_consensus.cc:697] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:09.317456 28930 consensus_queue.cc:237] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.324761 28666 tablet_bootstrap.cc:492] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:09.325325 28666 ts_tablet_manager.cc:1403] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.167s user 0.013s sys 0.051s
I20260928 07:56:09.327879 28666 raft_consensus.cc:359] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.323194 28656 ts_tablet_manager.cc:1929] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:09.328760 28656 log.cc:1199] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/c66d29eed5714db597516c573326153c
I20260928 07:56:09.329607 28656 ts_tablet_manager.cc:1950] T c66d29eed5714db597516c573326153c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:09.329969 28666 raft_consensus.cc:385] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.329407 27821 catalog_manager.cc:5838] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:09.330837 28657 ts_tablet_manager.cc:1929] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:09.330300 28666 raft_consensus.cc:740] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.333562 28657 log.cc:1199] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/c66d29eed5714db597516c573326153c
I20260928 07:56:09.334178 28666 consensus_queue.cc:260] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.335798 28662 tablet_bootstrap.cc:492] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:09.336232 28662 ts_tablet_manager.cc:1403] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.060s user 0.011s sys 0.001s
I20260928 07:56:09.341075 28657 ts_tablet_manager.cc:1950] T c66d29eed5714db597516c573326153c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:09.343158 28937 consensus_queue.cc:1048] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:09.339336 28662 raft_consensus.cc:359] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.345765 28662 raft_consensus.cc:385] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.346144 28662 raft_consensus.cc:740] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.350364 28662 consensus_queue.cc:260] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.354672 28666 ts_tablet_manager.cc:1434] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260928 07:56:09.361040 27824 catalog_manager.cc:2213] created HMS catalog entry for table [id=9786bf823c44447594c640824e210bc6]
I20260928 07:56:09.367116 28662 ts_tablet_manager.cc:1434] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20260928 07:56:09.367197 28658 ts_tablet_manager.cc:1929] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:09.367574 28658 log.cc:1199] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/c682ee6d2eaf4bd3902e35b9bec3db0d
I20260928 07:56:09.368203 28658 ts_tablet_manager.cc:1950] T c682ee6d2eaf4bd3902e35b9bec3db0d P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:09.369885 27822 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_995804006b294eb8a427e904cad03079"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:09.332922 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
W20260928 07:56:09.376964 27815 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 44063.4us
I20260928 07:56:09.377941 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:09.381376 28666 tablet_bootstrap.cc:492] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:09.381640 28937 consensus_queue.cc:1048] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:09.387830 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 103) took 1094 ms. Trace:
I20260928 07:56:09.388186 28658 rpcz_store.cc:276] 0928 07:56:08.293246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:08.293390 (+ 144us) service_pool.cc:224] Handling call
0928 07:56:09.017593 (+724203us) ts_tablet_manager.cc:1151] Deleting tablet c682ee6d2eaf4bd3902e35b9bec3db0d
0928 07:56:09.017634 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:09.267200 (+249566us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:09.367057 (+ 99857us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:09.387754 (+ 20697us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":723608}
I20260928 07:56:09.389608 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet c682ee6d2eaf4bd3902e35b9bec3db0d (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:09.396211 27824 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 64) took 3170 ms. Trace:
I20260928 07:56:09.396598 27824 rpcz_store.cc:276] 0928 07:56:06.226058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:06.226402 (+ 344us) service_pool.cc:224] Handling call
0928 07:56:06.436915 (+210513us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:06.438751 (+ 1836us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:09.360994 (+2922243us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:09.395474 (+ 34480us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:09.395829 (+ 355us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:09.396140 (+ 311us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:09.362875 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:09.363243 (+ 368us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:09.363265 (+ 22us) write_op.cc:435] Acquired schema lock
0928 07:56:09.363277 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:09.363535 (+ 258us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:09.363573 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:09.363594 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:09.363794 (+ 200us) tablet.cc:701] Row locks acquired
0928 07:56:09.363807 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:09.363917 (+ 110us) write_op.cc:270] Start()
0928 07:56:09.363998 (+ 81us) write_op.cc:276] Timestamp: P: 1790582169363834 usec, L: 0
0928 07:56:09.364013 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:09.364514 (+ 501us) log.cc:844] Serialized 433 byte log entry
0928 07:56:09.392412 (+ 27898us) op_driver.cc:464] REPLICATION: finished
0928 07:56:09.393554 (+ 1142us) write_op.cc:301] APPLY: starting
0928 07:56:09.393614 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:09.393754 (+ 140us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:09.393883 (+ 129us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:09.394282 (+ 399us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:09.394446 (+ 164us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:09.394486 (+ 40us) write_op.cc:312] APPLY: finished
0928 07:56:09.394675 (+ 189us) log.cc:844] Serialized 29 byte log entry
0928 07:56:09.394825 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:09.394904 (+ 79us) write_op.cc:454] Released schema lock
0928 07:56:09.394936 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:09.395175 (+ 239us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:09.395197 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2237285,"Hive Metastore.run_cpu_time_us":612,"Hive Metastore.run_wall_time_us":683564,"child_traces":[["op",{"apply.queue_time_us":973,"apply.run_cpu_time_us":1586,"apply.run_wall_time_us":1587,"num_ops":2,"prepare.queue_time_us":99,"prepare.run_cpu_time_us":1988,"prepare.run_wall_time_us":6116,"raft.queue_time_us":2600,"raft.run_cpu_time_us":589,"raft.run_wall_time_us":589,"replication_time_us":28300}]]}
I20260928 07:56:09.418478 28658 tablet_replica.cc:333] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:09.419282 28658 raft_consensus.cc:2243] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:09.419744 28658 raft_consensus.cc:2272] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.426290 28666 tablet_bootstrap.cc:654] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.432453 28658 ts_tablet_manager.cc:1916] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.438601 27820 catalog_manager.cc:5838] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:09.440338 28185 tablet_service.cc:1511] Processing CreateTablet for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.441395 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24ff6e06094b8c90e6b3fcf3d4f144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.442437 28329 tablet_service.cc:1511] Processing CreateTablet for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.443413 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24ff6e06094b8c90e6b3fcf3d4f144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.453886 28666 tablet_bootstrap.cc:492] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:09.454329 28666 ts_tablet_manager.cc:1403] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.073s user 0.009s sys 0.000s
I20260928 07:56:09.459852 28666 raft_consensus.cc:359] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.460482 28666 raft_consensus.cc:385] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.460732 28666 raft_consensus.cc:740] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.461527 28666 consensus_queue.cc:260] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.468953 28662 tablet_bootstrap.cc:492] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:09.478888 28662 tablet_bootstrap.cc:654] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.482031 28478 tablet_service.cc:1511] Processing CreateTablet for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (DEFAULT_TABLE table=default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.483153 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24ff6e06094b8c90e6b3fcf3d4f144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.496197 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet a3d9dd8311614adc8408685fa409e44f from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:09.498536 28666 ts_tablet_manager.cc:1434] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.044s user 0.007s sys 0.000s
I20260928 07:56:09.498811 28662 tablet_bootstrap.cc:492] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:09.499667 28662 ts_tablet_manager.cc:1403] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.009s
I20260928 07:56:09.510061 28666 tablet_bootstrap.cc:492] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:09.502578 28662 raft_consensus.cc:359] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.514737 28662 raft_consensus.cc:385] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.515045 28662 raft_consensus.cc:740] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.515759 28662 consensus_queue.cc:260] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.521924 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 4d73e199db0a4d93b60a36df144dc58f from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:09.520309 28662 ts_tablet_manager.cc:1434] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.020s user 0.006s sys 0.001s
I20260928 07:56:09.526731 28658 ts_tablet_manager.cc:1929] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:09.532754 28658 log.cc:1199] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/c66d29eed5714db597516c573326153c
I20260928 07:56:09.533672 28658 ts_tablet_manager.cc:1950] T c66d29eed5714db597516c573326153c P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:09.538343 28898 raft_consensus.cc:493] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.531469 28666 tablet_bootstrap.cc:654] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.538779 28898 raft_consensus.cc:515] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.540709 28898 leader_election.cc:290] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.542577 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d9dd8311614adc8408685fa409e44f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:09.542677 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet c66d29eed5714db597516c573326153c (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:09.543198 28349 raft_consensus.cc:2468] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:09.543298 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d9dd8311614adc8408685fa409e44f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:09.544849 28142 leader_election.cc:304] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
W20260928 07:56:09.545720 28141 leader_election.cc:343] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:09.546096 28930 raft_consensus.cc:493] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.546547 28898 raft_consensus.cc:2804] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:09.546510 28930 raft_consensus.cc:515] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.546922 28898 raft_consensus.cc:493] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:09.547259 28898 raft_consensus.cc:3060] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.548420 28930 leader_election.cc:290] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.549160 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 4d73e199db0a4d93b60a36df144dc58f
I20260928 07:56:09.550745 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532be147761546ecb660b4451018e1e1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:09.551332 28205 raft_consensus.cc:2468] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:09.553599 28434 leader_election.cc:304] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:09.554157 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d73e199db0a4d93b60a36df144dc58f with delete_type TABLET_DATA_DELETED (replaced by tablet 8b38e36c9bae4e9897787201e84cf681) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:09.554798 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 4d73e199db0a4d93b60a36df144dc58f deleted and replaced by tablet 8b38e36c9bae4e9897787201e84cf681
I20260928 07:56:09.554781 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532be147761546ecb660b4451018e1e1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:09.556037 28656 tablet_replica.cc:333] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:09.556792 28656 raft_consensus.cc:2243] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:09.557672 28656 raft_consensus.cc:2272] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.558866 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d73e199db0a4d93b60a36df144dc58f with delete_type TABLET_DATA_DELETED (replaced by tablet 8b38e36c9bae4e9897787201e84cf681) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:09.555392 28349 raft_consensus.cc:2468] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:09.559614 28657 tablet_replica.cc:333] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:09.560070 28656 ts_tablet_manager.cc:1916] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.560413 28657 raft_consensus.cc:2243] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:09.560907 28657 raft_consensus.cc:2272] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.561079 28930 raft_consensus.cc:2804] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:09.561458 28930 raft_consensus.cc:493] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:09.561784 28930 raft_consensus.cc:3060] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.564599 28657 ts_tablet_manager.cc:1916] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.558090 28898 raft_consensus.cc:515] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.569020 28667 tablet_bootstrap.cc:492] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:09.569473 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d73e199db0a4d93b60a36df144dc58f with delete_type TABLET_DATA_DELETED (replaced by tablet 8b38e36c9bae4e9897787201e84cf681) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:09.570058 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d9dd8311614adc8408685fa409e44f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:09.571723 28141 leader_election.cc:343] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:09.572815 28930 raft_consensus.cc:515] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.576947 28667 tablet_bootstrap.cc:654] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.573786 28658 tablet_replica.cc:333] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:09.578120 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d9dd8311614adc8408685fa409e44f" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:09.578780 28349 raft_consensus.cc:3060] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.583952 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532be147761546ecb660b4451018e1e1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:09.584535 28207 raft_consensus.cc:3060] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.586067 28349 raft_consensus.cc:2468] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:09.587371 28142 leader_election.cc:304] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:09.588332 28846 raft_consensus.cc:2804] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:09.591905 28207 raft_consensus.cc:2468] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:09.593158 28434 leader_election.cc:304] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:09.594117 28937 raft_consensus.cc:2804] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:09.594563 28937 raft_consensus.cc:697] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:09.595312 28937 consensus_queue.cc:237] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.602555 28846 raft_consensus.cc:697] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:09.604223 28846 consensus_queue.cc:237] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.607882 28658 raft_consensus.cc:2243] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:09.610203 28658 raft_consensus.cc:2272] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.612810 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532be147761546ecb660b4451018e1e1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:09.613340 28898 leader_election.cc:290] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.613533 28349 raft_consensus.cc:3060] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.609561 28657 ts_tablet_manager.cc:1929] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:09.617427 28657 log.cc:1199] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/4d73e199db0a4d93b60a36df144dc58f
I20260928 07:56:09.618232 28657 ts_tablet_manager.cc:1950] T 4d73e199db0a4d93b60a36df144dc58f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:09.619052 28930 leader_election.cc:290] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.620956 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 4d73e199db0a4d93b60a36df144dc58f (table default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:09.621080 28658 ts_tablet_manager.cc:1916] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.634984 28666 tablet_bootstrap.cc:492] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:09.635466 28666 ts_tablet_manager.cc:1403] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.126s user 0.009s sys 0.005s
I20260928 07:56:09.637811 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet a3d9dd8311614adc8408685fa409e44f
I20260928 07:56:09.639467 27821 catalog_manager.cc:6934] ReplaceTablet: tablet a3d9dd8311614adc8408685fa409e44f deleted and replaced by tablet af8c024a510c442caa981892d0469221
I20260928 07:56:09.639756 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet a3d9dd8311614adc8408685fa409e44f with delete_type TABLET_DATA_DELETED (replaced by tablet af8c024a510c442caa981892d0469221) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:09.640946 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet a3d9dd8311614adc8408685fa409e44f with delete_type TABLET_DATA_DELETED (replaced by tablet af8c024a510c442caa981892d0469221) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:09.643848 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet a3d9dd8311614adc8408685fa409e44f with delete_type TABLET_DATA_DELETED (replaced by tablet af8c024a510c442caa981892d0469221) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:09.644728 27824 catalog_manager.cc:5838] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:09.645958 28657 tablet_replica.cc:333] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:09.646766 28657 raft_consensus.cc:2243] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:09.647276 28657 raft_consensus.cc:2272] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.649153 28657 ts_tablet_manager.cc:1916] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.650576 28349 raft_consensus.cc:2468] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:09.629117 28656 ts_tablet_manager.cc:1929] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:09.655349 28656 log.cc:1199] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/4d73e199db0a4d93b60a36df144dc58f
I20260928 07:56:09.659730 28656 ts_tablet_manager.cc:1950] T 4d73e199db0a4d93b60a36df144dc58f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:09.662556 28666 raft_consensus.cc:359] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.663839 28185 tablet_service.cc:1511] Processing CreateTablet for tablet bbd54f8b0d9045bdad4c72d1c14c8af6 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.664965 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd54f8b0d9045bdad4c72d1c14c8af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.668787 28666 raft_consensus.cc:385] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.669126 28666 raft_consensus.cc:740] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.677562 28846 raft_consensus.cc:493] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.678146 28846 raft_consensus.cc:515] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.679303 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 4d73e199db0a4d93b60a36df144dc58f (table default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:09.674542 28666 consensus_queue.cc:260] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:09.681892 28329 tablet_service.cc:1511] Processing CreateTablet for tablet bbd54f8b0d9045bdad4c72d1c14c8af6 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.684053 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad8656a1c06494b9ebc9eb2e9512b41" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:09.684727 28499 raft_consensus.cc:2468] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:09.685120 28656 tablet_replica.cc:333] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:09.685969 28656 raft_consensus.cc:2243] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:09.686487 28141 leader_election.cc:304] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:09.687250 28898 raft_consensus.cc:2804] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:09.687328 28846 leader_election.cc:290] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:09.687646 28898 raft_consensus.cc:493] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:09.688005 28898 raft_consensus.cc:3060] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.688755 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd54f8b0d9045bdad4c72d1c14c8af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.689419 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad8656a1c06494b9ebc9eb2e9512b41" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:09.690008 28349 raft_consensus.cc:2468] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:09.688818 28667 tablet_bootstrap.cc:492] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:09.691722 28667 ts_tablet_manager.cc:1403] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.123s user 0.011s sys 0.000s
I20260928 07:56:09.693953 28478 tablet_service.cc:1511] Processing CreateTablet for tablet bbd54f8b0d9045bdad4c72d1c14c8af6 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.694278 28667 raft_consensus.cc:359] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.694881 28667 raft_consensus.cc:385] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.694979 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd54f8b0d9045bdad4c72d1c14c8af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.695118 28667 raft_consensus.cc:740] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.695176 28898 raft_consensus.cc:515] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.698043 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad8656a1c06494b9ebc9eb2e9512b41" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:09.698629 28351 raft_consensus.cc:3060] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.699240 28667 consensus_queue.cc:260] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.698334 27824 catalog_manager.cc:5838] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:09.705173 28351 raft_consensus.cc:2468] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:09.706501 28142 leader_election.cc:304] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:09.707495 28846 raft_consensus.cc:2804] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:09.707998 27821 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_457d1f751e7c405eb8466e6f18c185ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:09.708058 28846 raft_consensus.cc:697] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:09.682245 27820 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:09.710814 28667 ts_tablet_manager.cc:1434] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260928 07:56:09.711071 28846 consensus_queue.cc:237] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.722069 28666 ts_tablet_manager.cc:1434] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.086s user 0.008s sys 0.000s
W20260928 07:56:09.721990 27820 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bd24ff6e06094b8c90e6b3fcf3d4f144 consensus state has no leader
I20260928 07:56:09.723868 28657 ts_tablet_manager.cc:1929] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:09.724264 28657 log.cc:1199] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/a3d9dd8311614adc8408685fa409e44f
I20260928 07:56:09.731585 28662 tablet_bootstrap.cc:492] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:09.735646 28666 tablet_bootstrap.cc:492] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:09.746803 28662 tablet_bootstrap.cc:654] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.749168 28658 ts_tablet_manager.cc:1929] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:09.749593 28658 log.cc:1199] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/4d73e199db0a4d93b60a36df144dc58f
I20260928 07:56:09.750351 28658 ts_tablet_manager.cc:1950] T 4d73e199db0a4d93b60a36df144dc58f P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:09.752715 28658 tablet_replica.cc:333] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:09.753399 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 4d73e199db0a4d93b60a36df144dc58f (table default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:09.754364 28898 leader_election.cc:290] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:09.755676 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ad8656a1c06494b9ebc9eb2e9512b41" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:09.756309 28499 raft_consensus.cc:3060] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.766878 28666 tablet_bootstrap.cc:654] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.769704 28658 raft_consensus.cc:2243] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:09.770195 28658 raft_consensus.cc:2272] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.777585 28658 ts_tablet_manager.cc:1916] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.779805 27825 catalog_manager.cc:2213] created HMS catalog entry for table [id=7d3bf1f44d9443b78713cb43948ae519]
I20260928 07:56:09.783901 28499 raft_consensus.cc:2468] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:09.686692 28656 pending_rounds.cc:70] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:09.789865 28656 pending_rounds.cc:77] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224566710222848 op_type: NO_OP noop_request { }
I20260928 07:56:09.790305 28656 raft_consensus.cc:2889] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:09.790694 28656 raft_consensus.cc:2272] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.795277 28657 ts_tablet_manager.cc:1950] T a3d9dd8311614adc8408685fa409e44f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:09.796710 28092 catalog_manager.cc:2811] Deleting table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39] in response to Hive Metastore notification log event 18
I20260928 07:56:09.795960 27824 catalog_manager.cc:5838] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:09.799654 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet a3d9dd8311614adc8408685fa409e44f (table default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
I20260928 07:56:09.800323 27820 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]). Expected version 1 got 0
I20260928 07:56:09.810526 28185 tablet_service.cc:1511] Processing CreateTablet for tablet af8c024a510c442caa981892d0469221 (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.811616 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8c024a510c442caa981892d0469221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.813911 28331 tablet_service.cc:1511] Processing CreateTablet for tablet af8c024a510c442caa981892d0469221 (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.814046 28478 tablet_service.cc:1511] Processing CreateTablet for tablet af8c024a510c442caa981892d0469221 (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.815006 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8c024a510c442caa981892d0469221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.815026 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8c024a510c442caa981892d0469221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.823802 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 8b38e36c9bae4e9897787201e84cf681 (DEFAULT_TABLE table=default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.824898 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b38e36c9bae4e9897787201e84cf681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.827226 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 8b38e36c9bae4e9897787201e84cf681 (DEFAULT_TABLE table=default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.828465 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b38e36c9bae4e9897787201e84cf681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.833949 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 8b38e36c9bae4e9897787201e84cf681 (DEFAULT_TABLE table=default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.835063 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b38e36c9bae4e9897787201e84cf681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.840593 27825 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 60) took 4003 ms. Trace:
I20260928 07:56:09.840992 27825 rpcz_store.cc:276] 0928 07:56:05.837328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:05.837434 (+ 106us) service_pool.cc:224] Handling call
0928 07:56:06.432252 (+594818us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:06.442185 (+ 9933us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:09.779759 (+3337574us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:09.839834 (+ 60075us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:09.840187 (+ 353us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:09.840523 (+ 336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:09.791761 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:09.792227 (+ 466us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:09.792255 (+ 28us) write_op.cc:435] Acquired schema lock
0928 07:56:09.792269 (+ 14us) tablet.cc:662] Decoding operations
0928 07:56:09.792563 (+ 294us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:09.792609 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:09.792636 (+ 27us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:09.792880 (+ 244us) tablet.cc:701] Row locks acquired
0928 07:56:09.792897 (+ 17us) write_op.cc:260] PREPARE: finished
0928 07:56:09.793020 (+ 123us) write_op.cc:270] Start()
0928 07:56:09.793113 (+ 93us) write_op.cc:276] Timestamp: P: 1790582169792946 usec, L: 0
0928 07:56:09.793131 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 07:56:09.793696 (+ 565us) log.cc:844] Serialized 433 byte log entry
0928 07:56:09.836555 (+ 42859us) op_driver.cc:464] REPLICATION: finished
0928 07:56:09.837844 (+ 1289us) write_op.cc:301] APPLY: starting
0928 07:56:09.837910 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:09.838025 (+ 115us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:09.838122 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:09.838567 (+ 445us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:09.838721 (+ 154us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:09.838763 (+ 42us) write_op.cc:312] APPLY: finished
0928 07:56:09.838964 (+ 201us) log.cc:844] Serialized 29 byte log entry
0928 07:56:09.839159 (+ 195us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:09.839228 (+ 69us) write_op.cc:454] Released schema lock
0928 07:56:09.839272 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:09.839528 (+ 256us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:09.839554 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2917589,"Hive Metastore.run_cpu_time_us":772,"Hive Metastore.run_wall_time_us":419164,"child_traces":[["op",{"apply.queue_time_us":1111,"apply.run_cpu_time_us":1646,"apply.run_wall_time_us":1646,"num_ops":2,"prepare.queue_time_us":10283,"prepare.run_cpu_time_us":2366,"prepare.run_wall_time_us":12791,"raft.queue_time_us":5286,"raft.run_cpu_time_us":684,"raft.run_wall_time_us":683,"replication_time_us":43301}]]}
I20260928 07:56:09.855163 28656 ts_tablet_manager.cc:1916] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.860693 28666 tablet_bootstrap.cc:492] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:09.861135 28666 ts_tablet_manager.cc:1403] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.126s user 0.014s sys 0.003s
I20260928 07:56:09.865146 28666 raft_consensus.cc:359] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.866140 28666 raft_consensus.cc:385] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.866475 28666 raft_consensus.cc:740] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.867319 28666 consensus_queue.cc:260] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.868923 28658 ts_tablet_manager.cc:1929] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:09.869195 28666 ts_tablet_manager.cc:1434] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260928 07:56:09.870119 28666 tablet_bootstrap.cc:492] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:09.881444 28662 tablet_bootstrap.cc:492] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:09.881873 28662 ts_tablet_manager.cc:1403] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.151s user 0.009s sys 0.004s
I20260928 07:56:09.884475 28662 raft_consensus.cc:359] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.889493 28658 log.cc:1199] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/a3d9dd8311614adc8408685fa409e44f
I20260928 07:56:09.890244 28658 ts_tablet_manager.cc:1950] T a3d9dd8311614adc8408685fa409e44f P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:09.896821 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet a3d9dd8311614adc8408685fa409e44f (table default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
I20260928 07:56:09.900332 28092 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet bd24ff6e06094b8c90e6b3fcf3d4f144
I20260928 07:56:09.900399 28666 tablet_bootstrap.cc:654] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.901847 28667 tablet_bootstrap.cc:492] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:09.903273 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet a3d9dd8311614adc8408685fa409e44f from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:09.908972 28667 tablet_bootstrap.cc:654] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:09.914459 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:09 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:09.885100 28662 raft_consensus.cc:385] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.917459 28662 raft_consensus.cc:740] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.918080 28662 consensus_queue.cc:260] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.921272 28662 ts_tablet_manager.cc:1434] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.039s user 0.004s sys 0.003s
I20260928 07:56:09.946226 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:09 UTC) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:09.946533 28662 tablet_bootstrap.cc:492] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:09.947103 28657 tablet_replica.cc:333] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:09.948078 28657 raft_consensus.cc:2243] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:09.948635 28657 raft_consensus.cc:2272] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:09.950325 28666 tablet_bootstrap.cc:492] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:09.950814 28657 ts_tablet_manager.cc:1916] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:09.951113 28666 ts_tablet_manager.cc:1403] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.081s user 0.008s sys 0.001s
I20260928 07:56:09.955219 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 532be147761546ecb660b4451018e1e1 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:09.964294 28937 raft_consensus.cc:493] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:09.964838 28937 raft_consensus.cc:515] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.965366 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet a3d9dd8311614adc8408685fa409e44f with delete_type TABLET_DATA_DELETED (replaced by tablet af8c024a510c442caa981892d0469221) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:09.966837 28937 leader_election.cc:290] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:09.967572 28666 raft_consensus.cc:359] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.968194 28666 raft_consensus.cc:385] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:09.968448 28666 raft_consensus.cc:740] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:09.968986 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0480f5920b4ffc8592407417d42d92" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:09.970217 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0480f5920b4ffc8592407417d42d92" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:09.970937 28351 raft_consensus.cc:2393] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:09.970835 28328 tablet_service.cc:1511] Processing CreateTablet for tablet 93bcaa047c2b46f69b6c686e95053c1c (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:09.971990 28328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bcaa047c2b46f69b6c686e95053c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:09.971897 28666 consensus_queue.cc:260] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:09.972680 28434 leader_election.cc:304] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:09.984548 28666 ts_tablet_manager.cc:1434] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.033s user 0.008s sys 0.000s
I20260928 07:56:09.984997 28930 raft_consensus.cc:3060] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:09.990974 28656 ts_tablet_manager.cc:1929] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:09.994839 28937 consensus_queue.cc:1048] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:09.993098 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 93bcaa047c2b46f69b6c686e95053c1c (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.007388 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bcaa047c2b46f69b6c686e95053c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.014719 28662 tablet_bootstrap.cc:654] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.003970 28930 raft_consensus.cc:2749] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:10.016162 28667 tablet_bootstrap.cc:492] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:10.016630 28667 ts_tablet_manager.cc:1403] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.115s user 0.019s sys 0.001s
I20260928 07:56:10.004532 28666 tablet_bootstrap.cc:492] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:10.019251 28667 raft_consensus.cc:359] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.019886 28667 raft_consensus.cc:385] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.020223 28667 raft_consensus.cc:740] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
W20260928 07:56:09.967118 27814 catalog_manager.cc:5030] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet a3d9dd8311614adc8408685fa409e44f because the tablet was not found. No further retry: Not found: Tablet not found: a3d9dd8311614adc8408685fa409e44f
W20260928 07:56:10.021145 27814 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 54055.6us
I20260928 07:56:10.025323 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 93bcaa047c2b46f69b6c686e95053c1c (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.026579 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93bcaa047c2b46f69b6c686e95053c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.039949 28666 tablet_bootstrap.cc:654] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.006537 28656 log.cc:1199] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/a3d9dd8311614adc8408685fa409e44f
I20260928 07:56:10.044437 28656 ts_tablet_manager.cc:1950] T a3d9dd8311614adc8408685fa409e44f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:10.008985 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet bd24ff6e06094b8c90e6b3fcf3d4f144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:09 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:10.045503 28658 tablet_replica.cc:333] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:10.046442 28658 raft_consensus.cc:2243] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.046943 28658 raft_consensus.cc:2272] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.049410 28658 ts_tablet_manager.cc:1916] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.063531 28662 tablet_bootstrap.cc:492] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:10.064141 28662 ts_tablet_manager.cc:1403] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.118s user 0.012s sys 0.000s
I20260928 07:56:10.073537 28667 consensus_queue.cc:260] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.075973 28667 ts_tablet_manager.cc:1434] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.059s user 0.006s sys 0.001s
I20260928 07:56:10.078708 28662 raft_consensus.cc:359] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.079629 28662 raft_consensus.cc:385] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.080008 28662 raft_consensus.cc:740] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.081101 28662 consensus_queue.cc:260] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.104854 28666 tablet_bootstrap.cc:492] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:10.105341 28666 ts_tablet_manager.cc:1403] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.101s user 0.009s sys 0.004s
I20260928 07:56:10.105912 28937 consensus_queue.cc:1048] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:10.107031 28657 ts_tablet_manager.cc:1929] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:10.107420 28657 log.cc:1199] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/bd24ff6e06094b8c90e6b3fcf3d4f144
I20260928 07:56:10.108057 28657 ts_tablet_manager.cc:1950] T bd24ff6e06094b8c90e6b3fcf3d4f144 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:10.107843 28666 raft_consensus.cc:359] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.108469 28666 raft_consensus.cc:385] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.108719 28666 raft_consensus.cc:740] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.116691 28656 tablet_replica.cc:333] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:10.116876 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet a3d9dd8311614adc8408685fa409e44f (table default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
I20260928 07:56:10.117316 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 532be147761546ecb660b4451018e1e1
I20260928 07:56:10.117661 28656 raft_consensus.cc:2243] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.118571 28656 raft_consensus.cc:2272] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.119696 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 532be147761546ecb660b4451018e1e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cbffc3f34f94204966197ff989471ff) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:10.121681 28656 ts_tablet_manager.cc:1916] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.122216 27824 catalog_manager.cc:6934] ReplaceTablet: tablet 532be147761546ecb660b4451018e1e1 deleted and replaced by tablet 1cbffc3f34f94204966197ff989471ff
I20260928 07:56:10.124323 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 532be147761546ecb660b4451018e1e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cbffc3f34f94204966197ff989471ff) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:10.126665 28662 ts_tablet_manager.cc:1434] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.062s user 0.008s sys 0.001s
I20260928 07:56:10.129817 28662 tablet_bootstrap.cc:492] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:10.133358 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 532be147761546ecb660b4451018e1e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cbffc3f34f94204966197ff989471ff) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:10.141453 28666 consensus_queue.cc:260] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.134084 28667 tablet_bootstrap.cc:492] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:10.143036 28657 tablet_replica.cc:333] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:10.143875 28657 raft_consensus.cc:2243] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.144507 28657 raft_consensus.cc:2272] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.148654 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:10.153261 28956 consensus_queue.cc:1048] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:10.162087 28956 consensus_queue.cc:1048] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:10.162446 28657 ts_tablet_manager.cc:1916] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.162635 28666 ts_tablet_manager.cc:1434] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.057s user 0.005s sys 0.000s
I20260928 07:56:10.163727 28666 tablet_bootstrap.cc:492] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:10.172583 28662 tablet_bootstrap.cc:654] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.197355 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbffc3f34f94204966197ff989471ff (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.198388 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbffc3f34f94204966197ff989471ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.198020 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbffc3f34f94204966197ff989471ff (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.199745 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbffc3f34f94204966197ff989471ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.207701 27824 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_445618083a03421da2ce363c50d436ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:10.222059 28658 ts_tablet_manager.cc:1929] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:10.222445 28658 log.cc:1199] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/bd24ff6e06094b8c90e6b3fcf3d4f144
I20260928 07:56:10.220503 28667 tablet_bootstrap.cc:654] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.224195 28658 ts_tablet_manager.cc:1950] T bd24ff6e06094b8c90e6b3fcf3d4f144 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:10.230500 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
I20260928 07:56:10.231868 28658 tablet_replica.cc:333] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:10.232702 28658 raft_consensus.cc:2243] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:10.233804 28658 pending_rounds.cc:70] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Trying to abort 1 pending ops.
I20260928 07:56:10.233644 28328 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbffc3f34f94204966197ff989471ff (DEFAULT_TABLE table=default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.234094 28658 pending_rounds.cc:77] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224566687854592 op_type: NO_OP noop_request { }
I20260928 07:56:10.234474 28658 raft_consensus.cc:2889] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:10.234979 28658 raft_consensus.cc:2272] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.237368 28658 ts_tablet_manager.cc:1916] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.237406 28666 tablet_bootstrap.cc:654] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.241484 28972 tablet.cc:1751] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:10.250392 28328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbffc3f34f94204966197ff989471ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.255674 28976 tablet.cc:1751] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:10.256711 27825 master_service.cc:960] ReplaceTablet: received request to replace tablet e7aff6b3ddcb44089c0c1f938ed457b5 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:10.258087 28662 tablet_bootstrap.cc:492] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:10.258597 28662 ts_tablet_manager.cc:1403] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.131s user 0.002s sys 0.009s
I20260928 07:56:10.261511 28662 raft_consensus.cc:359] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.262283 28662 raft_consensus.cc:385] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.262586 28662 raft_consensus.cc:740] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.263373 28662 consensus_queue.cc:260] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.269857 28658 ts_tablet_manager.cc:1929] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:10.270226 28658 log.cc:1199] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/532be147761546ecb660b4451018e1e1
I20260928 07:56:10.270974 28658 ts_tablet_manager.cc:1950] T 532be147761546ecb660b4451018e1e1 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:10.277531 28656 ts_tablet_manager.cc:1929] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:10.278128 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 532be147761546ecb660b4451018e1e1 (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:10.281615 28092 catalog_manager.cc:2811] Deleting table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b] in response to Hive Metastore notification log event 20
I20260928 07:56:10.285480 28656 log.cc:1199] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/bd24ff6e06094b8c90e6b3fcf3d4f144
I20260928 07:56:10.289382 28666 tablet_bootstrap.cc:492] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:10.289860 28666 ts_tablet_manager.cc:1403] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.126s user 0.007s sys 0.005s
I20260928 07:56:10.292384 28666 raft_consensus.cc:359] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.293081 28666 raft_consensus.cc:385] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.293412 28666 raft_consensus.cc:740] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.294207 28666 consensus_queue.cc:260] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.298444 28666 ts_tablet_manager.cc:1434] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260928 07:56:10.308624 27820 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 7fa47d4f3bbb45f89a1750e512614b98 (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:10.310982 28656 ts_tablet_manager.cc:1950] T bd24ff6e06094b8c90e6b3fcf3d4f144 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:10.313498 28667 tablet_bootstrap.cc:492] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:10.314090 28667 ts_tablet_manager.cc:1403] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.181s user 0.037s sys 0.018s
I20260928 07:56:10.316598 28667 raft_consensus.cc:359] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.317253 28667 raft_consensus.cc:385] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.317550 28667 raft_consensus.cc:740] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.318167 28667 consensus_queue.cc:260] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.320773 28667 ts_tablet_manager.cc:1434] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260928 07:56:10.304924 28662 ts_tablet_manager.cc:1434] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.046s user 0.007s sys 0.001s
I20260928 07:56:10.332108 28657 ts_tablet_manager.cc:1929] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:10.332563 28657 log.cc:1199] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/532be147761546ecb660b4451018e1e1
I20260928 07:56:10.333298 28657 ts_tablet_manager.cc:1950] T 532be147761546ecb660b4451018e1e1 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:10.313198 28656 tablet_replica.cc:333] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:10.330273 28662 tablet_bootstrap.cc:492] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:10.305363 28930 consensus_queue.cc:1048] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:10.349385 28656 raft_consensus.cc:2243] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.349949 28656 raft_consensus.cc:2272] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.360908 28207 raft_consensus.cc:3060] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.309284 28971 tablet.cc:1751] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:10.317198 28936 raft_consensus.cc:493] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:10.365396 28936 raft_consensus.cc:515] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.367563 28936 leader_election.cc:290] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:10.372900 28667 tablet_bootstrap.cc:492] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:10.374893 28662 tablet_bootstrap.cc:654] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.376226 28666 tablet_bootstrap.cc:492] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:10.379465 28667 tablet_bootstrap.cc:654] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.381839 28666 tablet_bootstrap.cc:654] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.389348 28656 ts_tablet_manager.cc:1916] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.389781 28667 tablet_bootstrap.cc:492] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:10.390178 28667 ts_tablet_manager.cc:1403] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.003s
I20260928 07:56:10.313463 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet bd24ff6e06094b8c90e6b3fcf3d4f144 (table default.table_6ba15b125765407a97c61d226b03034e [id=527c9391fe3c46d8baaa5d45edb03c39]) successfully deleted
W20260928 07:56:10.393374 27815 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 79924.4us
I20260928 07:56:10.343204 27825 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet e7aff6b3ddcb44089c0c1f938ed457b5
I20260928 07:56:10.398543 27825 catalog_manager.cc:6934] ReplaceTablet: tablet e7aff6b3ddcb44089c0c1f938ed457b5 deleted and replaced by tablet f9c220bb07c945d8a8d8268543414dd6
I20260928 07:56:10.402447 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet e7aff6b3ddcb44089c0c1f938ed457b5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c220bb07c945d8a8d8268543414dd6) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:10.403347 28658 tablet_replica.cc:333] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:10.404165 28658 raft_consensus.cc:2243] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.404700 28658 raft_consensus.cc:2272] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.355693 28092 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 1cbffc3f34f94204966197ff989471ff
I20260928 07:56:10.405593 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b38e36c9bae4e9897787201e84cf681" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:10.407431 28658 ts_tablet_manager.cc:1916] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.407805 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet e7aff6b3ddcb44089c0c1f938ed457b5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c220bb07c945d8a8d8268543414dd6) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:10.407944 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cbffc3f34f94204966197ff989471ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:10 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:10.408553 28657 tablet_replica.cc:333] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:10.409308 28657 raft_consensus.cc:2243] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.409781 28657 raft_consensus.cc:2272] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.410744 28328 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cbffc3f34f94204966197ff989471ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:10 UTC) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:10.412807 28936 consensus_queue.cc:1048] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 07:56:10.414721 28434 leader_election.cc:343] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:10.424793 28658 ts_tablet_manager.cc:1929] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:10.443351 28657 ts_tablet_manager.cc:1916] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.425194 28658 log.cc:1199] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/e7aff6b3ddcb44089c0c1f938ed457b5
I20260928 07:56:10.454348 28658 ts_tablet_manager.cc:1950] T e7aff6b3ddcb44089c0c1f938ed457b5 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:10.457257 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet e7aff6b3ddcb44089c0c1f938ed457b5 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]) successfully deleted
W20260928 07:56:10.458541 27814 catalog_manager.cc:5030] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 1cbffc3f34f94204966197ff989471ff because the tablet was not found. No further retry: Not found: Tablet not found: 1cbffc3f34f94204966197ff989471ff
I20260928 07:56:10.460843 28666 tablet_bootstrap.cc:492] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:10.461333 28666 ts_tablet_manager.cc:1403] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.086s user 0.012s sys 0.007s
I20260928 07:56:10.463755 28666 raft_consensus.cc:359] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.464375 28666 raft_consensus.cc:385] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.464627 28666 raft_consensus.cc:740] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.465255 28666 consensus_queue.cc:260] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.472124 28662 tablet_bootstrap.cc:492] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:10.472592 28662 ts_tablet_manager.cc:1403] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.143s user 0.006s sys 0.004s
I20260928 07:56:10.476011 28662 raft_consensus.cc:359] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.481441 28666 ts_tablet_manager.cc:1434] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260928 07:56:10.487903 28666 tablet_bootstrap.cc:492] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:10.476639 28662 raft_consensus.cc:385] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.489482 28662 raft_consensus.cc:740] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.490188 28662 consensus_queue.cc:260] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.493139 28666 tablet_bootstrap.cc:654] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.495504 28657 ts_tablet_manager.cc:1929] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:10.498623 28662 ts_tablet_manager.cc:1434] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.026s user 0.004s sys 0.002s
I20260928 07:56:10.499768 28662 tablet_bootstrap.cc:492] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:10.500697 28930 raft_consensus.cc:493] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:10.501381 28930 raft_consensus.cc:515] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.503985 28930 leader_election.cc:290] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:10.505057 28479 tablet_service.cc:1511] Processing CreateTablet for tablet f9c220bb07c945d8a8d8268543414dd6 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.512468 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c220bb07c945d8a8d8268543414dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.495901 28657 log.cc:1199] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/e7aff6b3ddcb44089c0c1f938ed457b5
I20260928 07:56:10.518225 28657 ts_tablet_manager.cc:1950] T e7aff6b3ddcb44089c0c1f938ed457b5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:10.521166 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet e7aff6b3ddcb44089c0c1f938ed457b5 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]) successfully deleted
W20260928 07:56:10.522943 27815 catalog_manager.cc:5043] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet 1cbffc3f34f94204966197ff989471ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cbffc3f34f94204966197ff989471ff already in progress: creating tablet
I20260928 07:56:10.506150 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bcaa047c2b46f69b6c686e95053c1c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:10.502127 28330 tablet_service.cc:1511] Processing CreateTablet for tablet f9c220bb07c945d8a8d8268543414dd6 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.499487 28667 raft_consensus.cc:359] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.530567 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c220bb07c945d8a8d8268543414dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.530634 28667 raft_consensus.cc:385] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.530957 28667 raft_consensus.cc:740] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.531771 28667 consensus_queue.cc:260] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.532593 28349 raft_consensus.cc:2468] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:10.534397 28434 leader_election.cc:304] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:10.535197 28930 raft_consensus.cc:2804] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:10.535533 28930 raft_consensus.cc:493] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:10.535810 28930 raft_consensus.cc:3060] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.542464 28930 raft_consensus.cc:515] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.545626 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bcaa047c2b46f69b6c686e95053c1c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:10.546175 28349 raft_consensus.cc:3060] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.552886 28349 raft_consensus.cc:2468] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:10.559645 28434 leader_election.cc:304] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:10.560746 28936 raft_consensus.cc:2804] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:10.561350 28936 raft_consensus.cc:697] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:10.562587 28667 ts_tablet_manager.cc:1434] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.172s user 0.005s sys 0.001s
I20260928 07:56:10.562124 28936 consensus_queue.cc:237] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:10.563494 28667 tablet_bootstrap.cc:492] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:10.572098 28930 leader_election.cc:290] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:10.585142 28667 tablet_bootstrap.cc:654] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:10.589052 28142 consensus_peers.cc:597] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 -> Peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Couldn't send request to peer 3bd67de620c94af3b7c8e3ba7d42f980. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7aff6b3ddcb44089c0c1f938ed457b5. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:10.596267 28666 tablet_bootstrap.cc:492] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:10.596700 28666 ts_tablet_manager.cc:1403] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.109s user 0.028s sys 0.006s
I20260928 07:56:10.597690 28987 raft_consensus.cc:493] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:10.598877 28987 raft_consensus.cc:515] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.601162 28666 raft_consensus.cc:359] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.601959 28666 raft_consensus.cc:385] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.602257 28666 raft_consensus.cc:740] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.607370 28184 tablet_service.cc:1511] Processing CreateTablet for tablet f9c220bb07c945d8a8d8268543414dd6 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.608021 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cbffc3f34f94204966197ff989471ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:10 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:10.609848 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet e7aff6b3ddcb44089c0c1f938ed457b5 with delete_type TABLET_DATA_DELETED (replaced by tablet f9c220bb07c945d8a8d8268543414dd6) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:10.611882 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bcaa047c2b46f69b6c686e95053c1c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:10.617971 28662 tablet_bootstrap.cc:654] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.620657 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93bcaa047c2b46f69b6c686e95053c1c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:10.622731 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b38e36c9bae4e9897787201e84cf681" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:10.623462 28207 raft_consensus.cc:2468] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:10.629683 27820 catalog_manager.cc:6391] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9] alter complete (version 1)
I20260928 07:56:10.632520 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 8535ad2fe942494bbd892e639d8882c4 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:10.632779 28846 consensus_queue.cc:1048] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:10.637554 28666 consensus_queue.cc:260] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.646778 28666 ts_tablet_manager.cc:1434] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.050s user 0.006s sys 0.004s
I20260928 07:56:10.647161 28987 leader_election.cc:290] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:10.648319 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd54f8b0d9045bdad4c72d1c14c8af6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:10.648947 28349 raft_consensus.cc:2468] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:10.650262 28142 leader_election.cc:304] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:10.653429 28667 tablet_bootstrap.cc:492] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:10.653872 28667 ts_tablet_manager.cc:1403] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.091s user 0.008s sys 0.003s
I20260928 07:56:10.655380 28204 raft_consensus.cc:3060] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.656564 28667 raft_consensus.cc:359] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.657161 28667 raft_consensus.cc:385] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.657437 28667 raft_consensus.cc:740] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.658025 28667 consensus_queue.cc:260] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.661028 28846 raft_consensus.cc:2804] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:10.661458 28846 raft_consensus.cc:493] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:10.661779 28846 raft_consensus.cc:3060] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.667407 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd54f8b0d9045bdad4c72d1c14c8af6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:10.668027 28497 raft_consensus.cc:2468] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:10.672137 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 8535ad2fe942494bbd892e639d8882c4
I20260928 07:56:10.676252 28667 ts_tablet_manager.cc:1434] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260928 07:56:10.677150 28667 tablet_bootstrap.cc:492] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:10.679557 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 8535ad2fe942494bbd892e639d8882c4 with delete_type TABLET_DATA_DELETED (replaced by tablet ac6814b6cc3642bf8cb48fe7dced6833) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:10.680332 28657 tablet_replica.cc:333] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:10.681162 28657 raft_consensus.cc:2243] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.682855 28657 raft_consensus.cc:2272] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.683704 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 8535ad2fe942494bbd892e639d8882c4 with delete_type TABLET_DATA_DELETED (replaced by tablet ac6814b6cc3642bf8cb48fe7dced6833) from {username='slave'} at 127.0.0.1:54230
W20260928 07:56:10.683180 27816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.252:41205, user_credentials={real_user=slave}} blocked reactor thread for 76817.6us
W20260928 07:56:10.686803 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260928 07:56:10.685117 28657 ts_tablet_manager.cc:1916] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:10.687932 28142 consensus_peers.cc:597] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 -> Peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Couldn't send request to peer 3bd67de620c94af3b7c8e3ba7d42f980. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:10.690308 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c220bb07c945d8a8d8268543414dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.693112 28936 raft_consensus.cc:493] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:10.693624 28936 raft_consensus.cc:515] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.694882 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 8535ad2fe942494bbd892e639d8882c4 with delete_type TABLET_DATA_DELETED (replaced by tablet ac6814b6cc3642bf8cb48fe7dced6833) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:10.695605 28658 tablet_replica.cc:333] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:10.695662 28936 leader_election.cc:290] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:10.696357 28658 raft_consensus.cc:2243] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.696892 28658 raft_consensus.cc:2272] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.697670 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8c024a510c442caa981892d0469221" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:10.698302 28349 raft_consensus.cc:2468] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:10.699175 28658 ts_tablet_manager.cc:1916] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.699536 28434 leader_election.cc:304] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:10.700253 28936 raft_consensus.cc:2804] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:10.700559 28936 raft_consensus.cc:493] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:10.700839 28936 raft_consensus.cc:3060] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.706486 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 8535ad2fe942494bbd892e639d8882c4 deleted and replaced by tablet ac6814b6cc3642bf8cb48fe7dced6833
I20260928 07:56:10.712204 28667 tablet_bootstrap.cc:654] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.712049 27820 catalog_manager.cc:5838] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:10.713897 28666 tablet_bootstrap.cc:492] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:10.713901 28846 raft_consensus.cc:515] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.716589 28846 leader_election.cc:290] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:10.718441 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd54f8b0d9045bdad4c72d1c14c8af6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:10.719012 28349 raft_consensus.cc:3060] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.721158 28666 tablet_bootstrap.cc:654] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.722008 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd54f8b0d9045bdad4c72d1c14c8af6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:10.722579 28497 raft_consensus.cc:3060] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.729562 28497 raft_consensus.cc:2468] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:10.730855 28141 leader_election.cc:304] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:10.739566 28434 leader_election.cc:304] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:10.740310 28930 raft_consensus.cc:2804] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:10.740635 28930 raft_consensus.cc:493] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:10.740942 28930 raft_consensus.cc:3060] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.748169 28930 raft_consensus.cc:515] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.750623 28930 leader_election.cc:290] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:10.752988 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b38e36c9bae4e9897787201e84cf681" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:10.754113 28350 raft_consensus.cc:3060] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.756160 28666 tablet_bootstrap.cc:492] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:10.756691 28666 ts_tablet_manager.cc:1403] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.001s
I20260928 07:56:10.764379 28350 raft_consensus.cc:2468] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:10.766276 28434 leader_election.cc:304] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:10.769934 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8c024a510c442caa981892d0469221" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:10.770589 28207 raft_consensus.cc:2468] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:10.765314 28846 raft_consensus.cc:2804] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:10.772708 28846 raft_consensus.cc:697] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:10.773578 28846 consensus_queue.cc:237] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.768002 28666 raft_consensus.cc:359] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.777576 28666 raft_consensus.cc:385] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.777889 28666 raft_consensus.cc:740] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.786656 28667 tablet_bootstrap.cc:492] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:10.787122 28667 ts_tablet_manager.cc:1403] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.110s user 0.003s sys 0.008s
I20260928 07:56:10.787424 28204 raft_consensus.cc:2468] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:10.789551 28666 consensus_queue.cc:260] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.791028 28980 raft_consensus.cc:2804] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:10.791538 28666 ts_tablet_manager.cc:1434] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260928 07:56:10.791471 28980 raft_consensus.cc:697] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:10.792258 28980 consensus_queue.cc:237] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.792600 28667 raft_consensus.cc:359] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.793238 28667 raft_consensus.cc:385] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.793503 28667 raft_consensus.cc:740] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.794201 28667 consensus_queue.cc:260] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.796155 28656 ts_tablet_manager.cc:1929] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:10.798900 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cbffc3f34f94204966197ff989471ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:10 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:10.804517 28667 ts_tablet_manager.cc:1434] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20260928 07:56:10.809875 28667 tablet_bootstrap.cc:492] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:10.816267 28658 ts_tablet_manager.cc:1929] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 07:56:10.816691 28658 log.cc:1199] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/8535ad2fe942494bbd892e639d8882c4
I20260928 07:56:10.816692 28349 raft_consensus.cc:2468] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:10.820313 28658 ts_tablet_manager.cc:1950] T 8535ad2fe942494bbd892e639d8882c4 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:10.830926 28667 tablet_bootstrap.cc:654] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:10.839460 28936 raft_consensus.cc:515] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.840175 28330 tablet_service.cc:1511] Processing CreateTablet for tablet ac6814b6cc3642bf8cb48fe7dced6833 (DEFAULT_TABLE table=default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.841169 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6814b6cc3642bf8cb48fe7dced6833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.841564 28936 leader_election.cc:290] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:10.843312 28657 ts_tablet_manager.cc:1929] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 07:56:10.843645 28657 log.cc:1199] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/8535ad2fe942494bbd892e639d8882c4
I20260928 07:56:10.844362 28657 ts_tablet_manager.cc:1950] T 8535ad2fe942494bbd892e639d8882c4 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:10.853194 28328 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cbffc3f34f94204966197ff989471ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:10 UTC) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:10.857259 28479 tablet_service.cc:1511] Processing CreateTablet for tablet ac6814b6cc3642bf8cb48fe7dced6833 (DEFAULT_TABLE table=default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.858276 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6814b6cc3642bf8cb48fe7dced6833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.796599 28656 log.cc:1199] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/532be147761546ecb660b4451018e1e1
I20260928 07:56:10.798550 28662 tablet_bootstrap.cc:492] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:10.799475 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b38e36c9bae4e9897787201e84cf681" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:10.865528 28207 raft_consensus.cc:3060] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.866711 28667 tablet_bootstrap.cc:492] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:10.823055 28987 consensus_queue.cc:1048] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:10.867131 28667 ts_tablet_manager.cc:1403] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.000s
I20260928 07:56:10.870292 28662 ts_tablet_manager.cc:1403] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.371s user 0.014s sys 0.000s
I20260928 07:56:10.870664 28667 raft_consensus.cc:359] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.838631 28187 tablet_service.cc:1511] Processing CreateTablet for tablet ac6814b6cc3642bf8cb48fe7dced6833 (DEFAULT_TABLE table=default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:10.871671 28667 raft_consensus.cc:385] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.872000 28667 raft_consensus.cc:740] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.872864 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6814b6cc3642bf8cb48fe7dced6833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:10.878422 28207 raft_consensus.cc:2468] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:10.873063 28662 raft_consensus.cc:359] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.879956 28662 raft_consensus.cc:385] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:10.880369 28662 raft_consensus.cc:740] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:10.881065 28662 consensus_queue.cc:260] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.872649 28667 consensus_queue.cc:260] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.886154 28667 ts_tablet_manager.cc:1434] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20260928 07:56:10.900871 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8c024a510c442caa981892d0469221" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:10.902417 28349 raft_consensus.cc:3060] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.910066 28662 ts_tablet_manager.cc:1434] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.039s user 0.004s sys 0.003s
I20260928 07:56:10.919091 27826 catalog_manager.cc:3541] renamed table default.table_182658f932d9407599c8db9fcee8c679 [id=32c6fc06bd3943feafb83880480a76c2] in HMS: new name default.table_308d75eb3d2d411cbdf3c7891303e356
I20260928 07:56:10.919756 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:10.920714 28657 tablet_replica.cc:333] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:10.921607 28657 raft_consensus.cc:2243] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.922123 28657 raft_consensus.cc:2272] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.905977 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8c024a510c442caa981892d0469221" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:10.927431 28207 raft_consensus.cc:3060] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:10.930647 28657 ts_tablet_manager.cc:1916] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.930788 28656 ts_tablet_manager.cc:1950] T 532be147761546ecb660b4451018e1e1 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:10.931821 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:10.932482 28662 tablet_bootstrap.cc:492] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:10.933490 28658 tablet_replica.cc:333] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:10.934401 28658 raft_consensus.cc:2243] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.935087 28658 raft_consensus.cc:2272] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:10.954994 27825 catalog_manager.cc:5838] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:10.963907 28349 raft_consensus.cc:2468] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:10.964560 28657 ts_tablet_manager.cc:1929] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:10.964926 28657 log.cc:1199] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/1cbffc3f34f94204966197ff989471ff
I20260928 07:56:10.965508 28434 leader_election.cc:304] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:10.969835 28930 raft_consensus.cc:2804] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:10.970374 28930 raft_consensus.cc:697] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:10.971338 28930 consensus_queue.cc:237] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:10.979750 28656 tablet_replica.cc:333] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:10.980489 28656 raft_consensus.cc:2243] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:10.980895 28656 raft_consensus.cc:2272] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:10.988271 28936 raft_consensus.cc:670] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260928 07:56:10.990716 28658 ts_tablet_manager.cc:1916] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:10.993671 28657 ts_tablet_manager.cc:1950] T 1cbffc3f34f94204966197ff989471ff P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:10.998665 28667 tablet_bootstrap.cc:492] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:10.996120 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 1cbffc3f34f94204966197ff989471ff (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:10.990923 27820 catalog_manager.cc:5838] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:11.002571 28936 raft_consensus.cc:493] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:11.003257 28936 raft_consensus.cc:515] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.005645 28936 leader_election.cc:290] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:11.005927 28667 tablet_bootstrap.cc:654] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.008601 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c220bb07c945d8a8d8268543414dd6" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:11.009554 28349 raft_consensus.cc:2468] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:11.012631 28434 leader_election.cc:304] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:11.013844 28936 raft_consensus.cc:2804] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:11.014273 28936 raft_consensus.cc:493] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:11.014693 28936 raft_consensus.cc:3060] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:11.027134 28667 tablet_bootstrap.cc:492] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:11.027587 28667 ts_tablet_manager.cc:1403] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.000s
I20260928 07:56:11.030197 28667 raft_consensus.cc:359] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.030404 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c220bb07c945d8a8d8268543414dd6" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:11.030872 28667 raft_consensus.cc:385] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.031119 28667 raft_consensus.cc:740] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.031989 28667 consensus_queue.cc:260] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.032630 28656 ts_tablet_manager.cc:1916] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:11.043972 28667 ts_tablet_manager.cc:1434] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260928 07:56:11.050539 28662 tablet_bootstrap.cc:654] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.051608 28658 ts_tablet_manager.cc:1929] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:11.065043 28207 raft_consensus.cc:2468] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:11.052030 28658 log.cc:1199] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/1cbffc3f34f94204966197ff989471ff
I20260928 07:56:11.068608 28658 ts_tablet_manager.cc:1950] T 1cbffc3f34f94204966197ff989471ff P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:11.070869 28656 ts_tablet_manager.cc:1929] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:11.071318 28656 log.cc:1199] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/1cbffc3f34f94204966197ff989471ff
I20260928 07:56:11.071943 28656 ts_tablet_manager.cc:1950] T 1cbffc3f34f94204966197ff989471ff P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
W20260928 07:56:11.064857 28434 leader_election.cc:343] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:11.091485 28666 tablet_bootstrap.cc:492] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:11.071959 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 1cbffc3f34f94204966197ff989471ff (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:11.097518 28666 tablet_bootstrap.cc:654] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.097728 28656 tablet_replica.cc:333] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:11.073279 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 1cbffc3f34f94204966197ff989471ff (table default.table_e97da6ec4ba84945a7e55b4a764d1606 [id=b359a82ae911436791cbd92ed60f305b]) successfully deleted
I20260928 07:56:11.098466 28656 raft_consensus.cc:2243] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:11.099435 28656 raft_consensus.cc:2272] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:11.099805 28092 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b38e36c9bae4e9897787201e84cf681 consensus state has no leader
W20260928 07:56:11.101502 27821 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_457d1f751e7c405eb8466e6f18c185ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:56:11.101934 27824 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_445618083a03421da2ce363c50d436ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:11.102311 27827 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 55) took 5751 ms. Trace:
I20260928 07:56:11.102643 27827 rpcz_store.cc:276] 0928 07:56:05.350956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:05.353568 (+ 2612us) service_pool.cc:224] Handling call
0928 07:56:06.429382 (+1075814us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:11.102236 (+4672854us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":10433,"Hive Metastore.run_cpu_time_us":391,"Hive Metastore.run_wall_time_us":482121}
I20260928 07:56:11.107261 28656 ts_tablet_manager.cc:1916] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:11.108228 27828 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 52) took 5799 ms. Trace:
I20260928 07:56:11.109365 27829 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 54) took 5758 ms. Trace:
I20260928 07:56:11.109673 27829 rpcz_store.cc:276] 0928 07:56:05.350634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:05.355931 (+ 5297us) service_pool.cc:224] Handling call
0928 07:56:06.430176 (+1074245us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:11.109306 (+4679130us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":839398,"Hive Metastore.run_cpu_time_us":331,"Hive Metastore.run_wall_time_us":174827}
I20260928 07:56:11.110714 27829 master_service.cc:960] ReplaceTablet: received request to replace tablet 1cbffc3f34f94204966197ff989471ff from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:11.112073 27829 master_service.cc:960] ReplaceTablet: received request to replace tablet 532be147761546ecb660b4451018e1e1 from {username='slave'} at 127.0.0.1:51542
W20260928 07:56:11.114091 27823 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cf58487e79464a79a31128dfc7c26d09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:11.114828 28666 tablet_bootstrap.cc:492] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:11.115211 28666 ts_tablet_manager.cc:1403] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.005s
W20260928 07:56:11.117512 27822 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_995804006b294eb8a427e904cad03079 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:11.117548 28666 raft_consensus.cc:359] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.118172 28666 raft_consensus.cc:385] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.118420 28666 raft_consensus.cc:740] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.119028 28666 consensus_queue.cc:260] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.121421 28656 ts_tablet_manager.cc:1929] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:11.121740 28656 log.cc:1199] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/e7aff6b3ddcb44089c0c1f938ed457b5
I20260928 07:56:11.122617 28656 ts_tablet_manager.cc:1950] T e7aff6b3ddcb44089c0c1f938ed457b5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:11.108549 27828 rpcz_store.cc:276] 0928 07:56:05.309312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:05.309407 (+ 95us) service_pool.cc:224] Handling call
0928 07:56:06.429350 (+1119943us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:11.105382 (+4676032us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:11.107256 (+ 1874us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:11.108163 (+ 907us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":492485,"Hive Metastore.run_cpu_time_us":1989,"Hive Metastore.run_wall_time_us":347330}
I20260928 07:56:11.126750 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet e7aff6b3ddcb44089c0c1f938ed457b5 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]) successfully deleted
I20260928 07:56:11.127007 28656 tablet_replica.cc:333] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
W20260928 07:56:11.127559 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8b38e36c9bae4e9897787201e84cf681 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8b38e36c9bae4e9897787201e84cf681 consensus state has no leader
I20260928 07:56:11.127641 28656 raft_consensus.cc:2243] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:11.128495 28656 raft_consensus.cc:2272] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:11.131480 28666 ts_tablet_manager.cc:1434] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260928 07:56:11.144016 28656 ts_tablet_manager.cc:1916] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:11.158152 28662 tablet_bootstrap.cc:492] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:11.158690 28662 ts_tablet_manager.cc:1403] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.226s user 0.011s sys 0.000s
I20260928 07:56:11.159467 28656 ts_tablet_manager.cc:1929] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 07:56:11.159822 28656 log.cc:1199] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/8535ad2fe942494bbd892e639d8882c4
I20260928 07:56:11.160590 28656 ts_tablet_manager.cc:1950] T 8535ad2fe942494bbd892e639d8882c4 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:11.163951 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 8535ad2fe942494bbd892e639d8882c4 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]) successfully deleted
I20260928 07:56:11.164084 28662 raft_consensus.cc:359] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.167306 28662 raft_consensus.cc:385] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.167691 28662 raft_consensus.cc:740] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.168542 28662 consensus_queue.cc:260] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.028709 28936 raft_consensus.cc:515] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.191983 27825 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
W20260928 07:56:11.193866 27825 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet ac6814b6cc3642bf8cb48fe7dced6833 consensus state has no leader
I20260928 07:56:11.200273 28662 ts_tablet_manager.cc:1434] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260928 07:56:11.203662 28936 leader_election.cc:290] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:11.207907 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c220bb07c945d8a8d8268543414dd6" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:11.208549 28207 raft_consensus.cc:3060] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:11.223047 28349 raft_consensus.cc:1275] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Refusing update from remote peer bae11841a62f429a98a978de5b7bd60e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:11.226835 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c220bb07c945d8a8d8268543414dd6" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:11.227680 28662 tablet_bootstrap.cc:492] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:11.227718 28350 raft_consensus.cc:3060] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:11.229210 28204 raft_consensus.cc:1275] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Refusing update from remote peer bae11841a62f429a98a978de5b7bd60e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:11.216328 28207 raft_consensus.cc:2468] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:11.234520 28980 consensus_queue.cc:1048] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:11.241928 28350 raft_consensus.cc:2468] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:11.258905 28434 leader_election.cc:304] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:11.259646 28980 consensus_queue.cc:1048] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:11.260442 28936 raft_consensus.cc:2804] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:11.260895 28936 raft_consensus.cc:697] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:11.261840 28936 consensus_queue.cc:237] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.269057 27825 catalog_manager.cc:5838] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:11.271819 27825 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:11.272356 27821 catalog_manager.cc:2213] created HMS catalog entry for table [id=b306197c3c4c4a29a0bf677a8f8b54b9]
I20260928 07:56:11.315354 27820 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 8b38e36c9bae4e9897787201e84cf681 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:11.319881 27821 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 86) took 1703 ms. Trace:
I20260928 07:56:11.320179 28662 tablet_bootstrap.cc:654] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.320246 27821 rpcz_store.cc:276] 0928 07:56:09.616409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:09.640216 (+ 23807us) service_pool.cc:224] Handling call
0928 07:56:11.102181 (+1461965us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:11.103899 (+ 1718us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:11.272316 (+168417us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:11.319245 (+ 46929us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:11.319514 (+ 269us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:11.319802 (+ 288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:11.275438 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:11.275921 (+ 483us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:11.275944 (+ 23us) write_op.cc:435] Acquired schema lock
0928 07:56:11.275957 (+ 13us) tablet.cc:662] Decoding operations
0928 07:56:11.276238 (+ 281us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:11.276273 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:11.276305 (+ 32us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:11.276502 (+ 197us) tablet.cc:701] Row locks acquired
0928 07:56:11.276516 (+ 14us) write_op.cc:260] PREPARE: finished
0928 07:56:11.276620 (+ 104us) write_op.cc:270] Start()
0928 07:56:11.276691 (+ 71us) write_op.cc:276] Timestamp: P: 1790582171276554 usec, L: 0
0928 07:56:11.276705 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 07:56:11.277151 (+ 446us) log.cc:844] Serialized 433 byte log entry
0928 07:56:11.312204 (+ 35053us) op_driver.cc:464] REPLICATION: finished
0928 07:56:11.313147 (+ 943us) write_op.cc:301] APPLY: starting
0928 07:56:11.313203 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:11.313367 (+ 164us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:11.313513 (+ 146us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:11.314134 (+ 621us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:11.314345 (+ 211us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:11.314414 (+ 69us) write_op.cc:312] APPLY: finished
0928 07:56:11.314684 (+ 270us) log.cc:844] Serialized 29 byte log entry
0928 07:56:11.314912 (+ 228us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:11.315022 (+ 110us) write_op.cc:454] Released schema lock
0928 07:56:11.315070 (+ 48us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:11.315412 (+ 342us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:11.315456 (+ 44us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":37578,"Hive Metastore.run_cpu_time_us":608,"Hive Metastore.run_wall_time_us":128363,"child_traces":[["op",{"apply.queue_time_us":799,"apply.run_cpu_time_us":2201,"apply.run_wall_time_us":2200,"num_ops":2,"prepare.queue_time_us":1699,"prepare.run_cpu_time_us":2064,"prepare.run_wall_time_us":34159,"raft.queue_time_us":141,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":221,"replication_time_us":35414}]]}
I20260928 07:56:11.325055 28965 mvcc.cc:204] Tried to move back new op lower bound from 7334224573213503488 to 7334224571588898816. Current Snapshot: MvccSnapshot[applied={T|T < 7334224573213503488}]
I20260928 07:56:11.327934 29012 tablet.cc:1751] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:11.336864 27827 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_66df2d021af141bf9af764fb609f0941" } modify_external_catalogs: true
I20260928 07:56:11.337657 27827 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_66df2d021af141bf9af764fb609f0941" } modify_external_catalogs: true
I20260928 07:56:11.338519 27829 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_1bf0b919ff68446aae3e010b1984050d" } modify_external_catalogs: true
I20260928 07:56:11.339175 27829 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_1bf0b919ff68446aae3e010b1984050d" } modify_external_catalogs: true
I20260928 07:56:11.360232 27821 catalog_manager.cc:5838] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:11.361537 27825 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_c9320b8b140446b882ec239e50aabb4f" } new_table_name: "default.Table_4406084e67ac4a3a86bbb72e9c6d569a" modify_external_catalogs: true
I20260928 07:56:11.364529 28330 tablet_service.cc:1511] Processing CreateTablet for tablet e3f2a6f83c8049628fe946a9d45152c5 (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.365682 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f2a6f83c8049628fe946a9d45152c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.372648 28479 tablet_service.cc:1511] Processing CreateTablet for tablet e3f2a6f83c8049628fe946a9d45152c5 (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.373716 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f2a6f83c8049628fe946a9d45152c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.393136 28187 tablet_service.cc:1511] Processing CreateTablet for tablet e3f2a6f83c8049628fe946a9d45152c5 (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.394364 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f2a6f83c8049628fe946a9d45152c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.410959 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 8b38e36c9bae4e9897787201e84cf681 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:11.419389 27828 master_service.cc:960] ReplaceTablet: received request to replace tablet 8b38e36c9bae4e9897787201e84cf681 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:11.434355 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 8b38e36c9bae4e9897787201e84cf681
I20260928 07:56:11.436062 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 8b38e36c9bae4e9897787201e84cf681 deleted and replaced by tablet 2aac87ee995c415f8c4151ca1b926b10
I20260928 07:56:11.437259 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b38e36c9bae4e9897787201e84cf681 with delete_type TABLET_DATA_DELETED (replaced by tablet 2aac87ee995c415f8c4151ca1b926b10) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:11.437932 28658 tablet_replica.cc:333] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:11.438498 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b38e36c9bae4e9897787201e84cf681 with delete_type TABLET_DATA_DELETED (replaced by tablet 2aac87ee995c415f8c4151ca1b926b10) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:11.438676 28658 raft_consensus.cc:2243] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:11.439205 28656 tablet_replica.cc:333] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:11.439304 28658 raft_consensus.cc:2272] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:11.440841 28328 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b38e36c9bae4e9897787201e84cf681 with delete_type TABLET_DATA_DELETED (replaced by tablet 2aac87ee995c415f8c4151ca1b926b10) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:11.441646 28657 tablet_replica.cc:333] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:11.444888 29013 tablet.cc:1751] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:11.447495 28662 tablet_bootstrap.cc:492] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:11.447921 28662 ts_tablet_manager.cc:1403] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.220s user 0.010s sys 0.000s
I20260928 07:56:11.448360 28657 raft_consensus.cc:2243] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:11.454816 28657 raft_consensus.cc:2272] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:11.453235 29015 tablet.cc:1751] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:11.460091 28662 raft_consensus.cc:359] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.460744 28662 raft_consensus.cc:385] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.470010 28667 tablet_bootstrap.cc:492] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:11.475412 28667 tablet_bootstrap.cc:654] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.476266 28666 tablet_bootstrap.cc:492] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:11.477442 28656 raft_consensus.cc:2243] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:11.478739 28656 raft_consensus.cc:2272] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:11.482962 28666 tablet_bootstrap.cc:654] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.485898 28667 tablet_bootstrap.cc:492] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:11.486281 28667 ts_tablet_manager.cc:1403] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.001s
I20260928 07:56:11.488545 28667 raft_consensus.cc:359] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.461017 28662 raft_consensus.cc:740] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.493750 28662 consensus_queue.cc:260] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.495776 28662 ts_tablet_manager.cc:1434] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.038s user 0.001s sys 0.003s
I20260928 07:56:11.489158 28667 raft_consensus.cc:385] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.502157 28667 raft_consensus.cc:740] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.506132 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 2aac87ee995c415f8c4151ca1b926b10 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.507910 27820 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:11.514508 28667 consensus_queue.cc:260] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.523651 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aac87ee995c415f8c4151ca1b926b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.530763 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 2aac87ee995c415f8c4151ca1b926b10 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.531826 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aac87ee995c415f8c4151ca1b926b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.535835 28937 consensus_queue.cc:1048] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:11.537999 28667 ts_tablet_manager.cc:1434] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.051s user 0.007s sys 0.000s
I20260928 07:56:11.538834 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 2aac87ee995c415f8c4151ca1b926b10 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.542342 28666 tablet_bootstrap.cc:492] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:11.542775 28666 ts_tablet_manager.cc:1403] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.067s user 0.015s sys 0.001s
I20260928 07:56:11.542610 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aac87ee995c415f8c4151ca1b926b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.549366 27820 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_c8c37153157644cba24992442f231936"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:11.552690 28666 raft_consensus.cc:359] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.553371 28666 raft_consensus.cc:385] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.553624 28666 raft_consensus.cc:740] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.554301 28666 consensus_queue.cc:260] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.566449 28666 ts_tablet_manager.cc:1434] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260928 07:56:11.575544 28657 ts_tablet_manager.cc:1916] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:11.579147 28658 ts_tablet_manager.cc:1916] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:11.590971 28987 consensus_queue.cc:1048] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:11.595492 28936 consensus_queue.cc:1048] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:11.622745 28666 tablet_bootstrap.cc:492] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:11.628435 28666 tablet_bootstrap.cc:654] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.643062 28658 ts_tablet_manager.cc:1929] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:11.647462 28658 log.cc:1199] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/8b38e36c9bae4e9897787201e84cf681
I20260928 07:56:11.651559 28666 tablet_bootstrap.cc:492] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:11.651858 28662 tablet_bootstrap.cc:492] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:11.651811 28657 ts_tablet_manager.cc:1929] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:11.652165 28657 log.cc:1199] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/8b38e36c9bae4e9897787201e84cf681
I20260928 07:56:11.652235 28666 ts_tablet_manager.cc:1403] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.000s
I20260928 07:56:11.653021 28657 ts_tablet_manager.cc:1950] T 8b38e36c9bae4e9897787201e84cf681 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:11.654776 28666 raft_consensus.cc:359] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.655297 27824 catalog_manager.cc:2213] created HMS catalog entry for table [id=70e3f9e8536c49d3b69119f2f2968ba5]
I20260928 07:56:11.655694 28658 ts_tablet_manager.cc:1950] T 8b38e36c9bae4e9897787201e84cf681 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:11.663190 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 8b38e36c9bae4e9897787201e84cf681 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:11.663414 28656 ts_tablet_manager.cc:1916] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:11.670439 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 8b38e36c9bae4e9897787201e84cf681 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:11.655431 28666 raft_consensus.cc:385] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.671432 28666 raft_consensus.cc:740] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.671836 27824 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 89) took 1570 ms. Trace:
I20260928 07:56:11.672158 28666 consensus_queue.cc:260] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.676312 28666 ts_tablet_manager.cc:1434] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260928 07:56:11.672142 27824 rpcz_store.cc:276] 0928 07:56:10.101468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:10.128156 (+ 26688us) service_pool.cc:224] Handling call
0928 07:56:10.207586 (+ 79430us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54000203d4. stack: 00007f6ecc595323 00007f6ecc595220 00007f6ecc139574 0000000000516964 00000000005168f9 00007f6ed36935c0 00007f6ed37326fa 00007f6ed54a3d8c 00007f6ed55a3566 00007f6ed314e034 00007f6ed314dfc2 00007f6ed314def1 00007f6ed314de6c 00007f6ed314d122 00007f6ed13f809c 00007f6ed13f74d6
0928 07:56:11.102415 (+894829us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:11.105844 (+ 3429us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:11.655253 (+549409us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:11.671185 (+ 15932us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:11.671476 (+ 291us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:11.671763 (+ 287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:11.657050 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:11.657475 (+ 425us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:11.657499 (+ 24us) write_op.cc:435] Acquired schema lock
0928 07:56:11.657511 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:11.657784 (+ 273us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:11.657834 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:11.657857 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:11.658045 (+ 188us) tablet.cc:701] Row locks acquired
0928 07:56:11.658059 (+ 14us) write_op.cc:260] PREPARE: finished
0928 07:56:11.658174 (+ 115us) write_op.cc:270] Start()
0928 07:56:11.658255 (+ 81us) write_op.cc:276] Timestamp: P: 1790582171658119 usec, L: 0
0928 07:56:11.658271 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 07:56:11.658751 (+ 480us) log.cc:844] Serialized 433 byte log entry
0928 07:56:11.667850 (+ 9099us) op_driver.cc:464] REPLICATION: finished
0928 07:56:11.668193 (+ 343us) write_op.cc:301] APPLY: starting
0928 07:56:11.668243 (+ 50us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:11.668337 (+ 94us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:11.668416 (+ 79us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:11.668809 (+ 393us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:11.668925 (+ 116us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:11.668961 (+ 36us) write_op.cc:312] APPLY: finished
0928 07:56:11.669131 (+ 170us) log.cc:844] Serialized 29 byte log entry
0928 07:56:11.669286 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:11.669349 (+ 63us) write_op.cc:454] Released schema lock
0928 07:56:11.669378 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:11.669577 (+ 199us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:11.669595 (+ 18us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":164094,"Hive Metastore.run_cpu_time_us":670,"Hive Metastore.run_wall_time_us":384153,"spinlock_wait_cycles":44910976,"child_traces":[["op",{"apply.queue_time_us":223,"apply.run_cpu_time_us":1355,"apply.run_wall_time_us":1352,"num_ops":2,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":2086,"prepare.run_wall_time_us":3708,"raft.queue_time_us":2194,"raft.run_cpu_time_us":651,"raft.run_wall_time_us":652,"replication_time_us":9481}]]}
I20260928 07:56:11.690158 28662 tablet_bootstrap.cc:654] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.716430 28328 tablet_service.cc:1511] Processing CreateTablet for tablet 608a4d03b3e341a2898ce42d86288d54 (DEFAULT_TABLE table=default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.717734 28328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608a4d03b3e341a2898ce42d86288d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.702996 28987 consensus_queue.cc:1048] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 07:56:11.705520 28142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 70618.1us
I20260928 07:56:11.730567 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 608a4d03b3e341a2898ce42d86288d54 (DEFAULT_TABLE table=default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.731706 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608a4d03b3e341a2898ce42d86288d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.741796 29026 raft_consensus.cc:493] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:11.742261 29026 raft_consensus.cc:515] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.753690 28921 raft_consensus.cc:493] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:11.754245 28921 raft_consensus.cc:515] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.756384 28921 leader_election.cc:290] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:11.758685 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6814b6cc3642bf8cb48fe7dced6833" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:11.759333 28499 raft_consensus.cc:2468] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:11.759454 28662 tablet_bootstrap.cc:492] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:11.759894 28662 ts_tablet_manager.cc:1403] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.108s user 0.006s sys 0.008s
I20260928 07:56:11.760815 28285 leader_election.cc:304] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:11.761754 28921 raft_consensus.cc:2804] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:11.762189 28921 raft_consensus.cc:493] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:11.762588 28921 raft_consensus.cc:3060] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:11.772063 29026 leader_election.cc:290] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:11.773975 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6814b6cc3642bf8cb48fe7dced6833" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:11.780331 28921 raft_consensus.cc:515] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.781741 28666 tablet_bootstrap.cc:492] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:11.782294 28351 raft_consensus.cc:2393] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate acdaa3cf2ffd45f5b55a169c1bacead5 in current term 1: Already voted for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in this term.
I20260928 07:56:11.785569 27823 catalog_manager.cc:2213] created HMS catalog entry for table [id=88d7ad10b80e4de1ac51b0f3506b8072]
I20260928 07:56:11.787506 28666 tablet_bootstrap.cc:654] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.793643 27824 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:11.794859 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6814b6cc3642bf8cb48fe7dced6833" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:11.795428 28499 raft_consensus.cc:3060] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:11.800678 28141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 98313.6us
I20260928 07:56:11.801995 28499 raft_consensus.cc:2468] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:11.803294 28285 leader_election.cc:304] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:11.809285 28666 tablet_bootstrap.cc:492] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:11.809749 28666 ts_tablet_manager.cc:1403] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.000s
I20260928 07:56:11.813753 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6814b6cc3642bf8cb48fe7dced6833" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:11.814320 28204 raft_consensus.cc:3060] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:11.812672 28666 raft_consensus.cc:359] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.815337 28666 raft_consensus.cc:385] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.815593 28666 raft_consensus.cc:740] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.817562 28666 consensus_queue.cc:260] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.818401 28662 raft_consensus.cc:359] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.819026 28662 raft_consensus.cc:385] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.819285 28662 raft_consensus.cc:740] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.820463 28667 tablet_bootstrap.cc:492] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:11.822131 28204 raft_consensus.cc:2468] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:11.823462 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6814b6cc3642bf8cb48fe7dced6833" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:11.824316 28499 raft_consensus.cc:2393] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate acdaa3cf2ffd45f5b55a169c1bacead5 in current term 1: Already voted for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in this term.
I20260928 07:56:11.825877 28667 tablet_bootstrap.cc:654] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.825816 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6814b6cc3642bf8cb48fe7dced6833" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:11.826424 28207 raft_consensus.cc:2376] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1. Re-sending same reply.
I20260928 07:56:11.826982 28921 leader_election.cc:290] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:11.828426 28141 leader_election.cc:304] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:11.828469 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 608a4d03b3e341a2898ce42d86288d54 (DEFAULT_TABLE table=default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:11.829504 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608a4d03b3e341a2898ce42d86288d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:11.829476 28987 raft_consensus.cc:2749] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:11.830156 28921 raft_consensus.cc:2804] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:11.805856 27823 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 77) took 3922 ms. Trace:
I20260928 07:56:11.833060 28921 raft_consensus.cc:697] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:11.837451 28936 consensus_queue.cc:1048] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:11.832549 27823 rpcz_store.cc:276] 0928 07:56:07.883069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:07.886007 (+ 2938us) service_pool.cc:224] Handling call
0928 07:56:11.114471 (+3228464us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:11.116090 (+ 1619us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:11.785529 (+669439us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:11.805198 (+ 19669us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:11.805522 (+ 324us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:11.805785 (+ 263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:11.787199 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:11.787596 (+ 397us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:11.787620 (+ 24us) write_op.cc:435] Acquired schema lock
0928 07:56:11.787631 (+ 11us) tablet.cc:662] Decoding operations
0928 07:56:11.787906 (+ 275us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:11.787944 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:11.787965 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:11.788164 (+ 199us) tablet.cc:701] Row locks acquired
0928 07:56:11.788177 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:11.788293 (+ 116us) write_op.cc:270] Start()
0928 07:56:11.788377 (+ 84us) write_op.cc:276] Timestamp: P: 1790582171788224 usec, L: 0
0928 07:56:11.788390 (+ 13us) op_driver.cc:348] REPLICATION: starting
0928 07:56:11.788905 (+ 515us) log.cc:844] Serialized 433 byte log entry
0928 07:56:11.798874 (+ 9969us) op_driver.cc:464] REPLICATION: finished
0928 07:56:11.799178 (+ 304us) write_op.cc:301] APPLY: starting
0928 07:56:11.799228 (+ 50us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:11.799317 (+ 89us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:11.799393 (+ 76us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:11.799692 (+ 299us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:11.799802 (+ 110us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:11.799858 (+ 56us) write_op.cc:312] APPLY: finished
0928 07:56:11.800006 (+ 148us) log.cc:844] Serialized 29 byte log entry
0928 07:56:11.800139 (+ 133us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:11.800199 (+ 60us) write_op.cc:454] Released schema lock
0928 07:56:11.800225 (+ 26us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:11.800401 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:11.800420 (+ 19us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":538114,"Hive Metastore.run_cpu_time_us":642,"Hive Metastore.run_wall_time_us":130761,"child_traces":[["op",{"apply.queue_time_us":166,"apply.run_cpu_time_us":1201,"apply.run_wall_time_us":1201,"num_ops":2,"prepare.queue_time_us":155,"prepare.run_cpu_time_us":1988,"prepare.run_wall_time_us":1988,"raft.queue_time_us":1208,"raft.run_cpu_time_us":657,"raft.run_wall_time_us":657,"replication_time_us":10393}]]}
I20260928 07:56:11.838311 28921 consensus_queue.cc:237] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.841069 28666 ts_tablet_manager.cc:1434] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.031s user 0.002s sys 0.004s
I20260928 07:56:11.849337 28656 ts_tablet_manager.cc:1929] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:11.849926 28656 log.cc:1199] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/8b38e36c9bae4e9897787201e84cf681
I20260928 07:56:11.855185 28667 tablet_bootstrap.cc:492] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:11.855612 28667 ts_tablet_manager.cc:1403] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.035s user 0.010s sys 0.001s
I20260928 07:56:11.862346 28667 raft_consensus.cc:359] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.862982 28667 raft_consensus.cc:385] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:11.863212 28667 raft_consensus.cc:740] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:11.870407 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 2aac87ee995c415f8c4151ca1b926b10 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:11.876093 28936 raft_consensus.cc:493] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:11.876286 28667 consensus_queue.cc:260] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.876572 28936 raft_consensus.cc:515] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.785071 27828 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:11.878317 28667 ts_tablet_manager.cc:1434] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.022s user 0.002s sys 0.005s
I20260928 07:56:11.878485 28936 leader_election.cc:290] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
W20260928 07:56:11.890549 28434 leader_election.cc:343] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 2aac87ee995c415f8c4151ca1b926b10
I20260928 07:56:11.893142 28921 raft_consensus.cc:493] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:11.893682 28921 raft_consensus.cc:515] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.899231 28921 leader_election.cc:290] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:11.902477 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608a4d03b3e341a2898ce42d86288d54" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:11.903108 28497 raft_consensus.cc:2468] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
W20260928 07:56:11.907384 27828 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2aac87ee995c415f8c4151ca1b926b10 consensus state has no leader
I20260928 07:56:11.912393 28285 leader_election.cc:304] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:11.916925 28937 consensus_queue.cc:1048] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:11.923887 29028 raft_consensus.cc:2804] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:11.924319 29028 raft_consensus.cc:493] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:11.924680 29028 raft_consensus.cc:3060] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:11.935371 29028 raft_consensus.cc:515] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.958715 27822 catalog_manager.cc:2213] created HMS catalog entry for table [id=58206f61fd6944d390df969d8d038e71]
I20260928 07:56:11.961073 29028 leader_election.cc:290] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:11.965211 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608a4d03b3e341a2898ce42d86288d54" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:11.965842 28497 raft_consensus.cc:3060] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:11.863991 28662 consensus_queue.cc:260] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:11.880753 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aac87ee995c415f8c4151ca1b926b10" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:11.898065 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608a4d03b3e341a2898ce42d86288d54" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:11.986780 28662 ts_tablet_manager.cc:1434] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.227s user 0.003s sys 0.004s
I20260928 07:56:11.987643 28662 tablet_bootstrap.cc:492] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:11.987735 28656 ts_tablet_manager.cc:1950] T 8b38e36c9bae4e9897787201e84cf681 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:11.955761 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608a4d03b3e341a2898ce42d86288d54" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
W20260928 07:56:11.986394 28286 leader_election.cc:343] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:11.990049 28434 leader_election.cc:343] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:11.990437 28286 leader_election.cc:343] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:11.990496 28434 leader_election.cc:304] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:11.994059 28937 raft_consensus.cc:2749] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:11.995572 28497 raft_consensus.cc:2468] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:11.995649 28662 tablet_bootstrap.cc:654] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:11.997646 28285 leader_election.cc:304] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:11.998991 29028 raft_consensus.cc:2804] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:11.999567 29028 raft_consensus.cc:697] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:12.004012 27821 catalog_manager.cc:5838] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:12.005409 27821 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:12.002539 29028 consensus_queue.cc:237] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.011175 28667 tablet_bootstrap.cc:492] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:12.017611 28667 tablet_bootstrap.cc:654] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:12.031497 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 8b38e36c9bae4e9897787201e84cf681 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:12.035157 27822 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 83) took 3103 ms. Trace:
I20260928 07:56:12.035497 27822 rpcz_store.cc:276] 0928 07:56:08.931592 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:09.369525 (+437933us) service_pool.cc:224] Handling call
0928 07:56:11.117906 (+1748381us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:11.119583 (+ 1677us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:11.958671 (+839088us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:11.977586 (+ 18915us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:12.034805 (+ 57219us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:12.035093 (+ 288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:11.960314 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:11.960695 (+ 381us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:11.960718 (+ 23us) write_op.cc:435] Acquired schema lock
0928 07:56:11.960731 (+ 13us) tablet.cc:662] Decoding operations
0928 07:56:11.960996 (+ 265us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:11.961036 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:11.961058 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:11.961269 (+ 211us) tablet.cc:701] Row locks acquired
0928 07:56:11.961282 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:11.961394 (+ 112us) write_op.cc:270] Start()
0928 07:56:11.961472 (+ 78us) write_op.cc:276] Timestamp: P: 1790582171961306 usec, L: 0
0928 07:56:11.961487 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:11.961947 (+ 460us) log.cc:844] Serialized 433 byte log entry
0928 07:56:11.974684 (+ 12737us) op_driver.cc:464] REPLICATION: finished
0928 07:56:11.975126 (+ 442us) write_op.cc:301] APPLY: starting
0928 07:56:11.975184 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:11.975300 (+ 116us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:11.975409 (+ 109us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:11.975785 (+ 376us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:11.976076 (+ 291us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:11.976114 (+ 38us) write_op.cc:312] APPLY: finished
0928 07:56:11.976292 (+ 178us) log.cc:844] Serialized 29 byte log entry
0928 07:56:11.976432 (+ 140us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:11.976499 (+ 67us) write_op.cc:454] Released schema lock
0928 07:56:11.976527 (+ 28us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:11.976751 (+ 224us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:11.976770 (+ 19us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":665534,"Hive Metastore.run_cpu_time_us":683,"Hive Metastore.run_wall_time_us":172797,"child_traces":[["op",{"apply.queue_time_us":297,"apply.run_cpu_time_us":1596,"apply.run_wall_time_us":1595,"num_ops":2,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":1929,"prepare.run_wall_time_us":1929,"raft.queue_time_us":2290,"raft.run_cpu_time_us":580,"raft.run_wall_time_us":581,"replication_time_us":13094}]]}
I20260928 07:56:12.045205 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet e3f2a6f83c8049628fe946a9d45152c5 from {username='slave'} at 127.0.0.1:51542
W20260928 07:56:12.045707 27820 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c8c37153157644cba24992442f231936 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:12.052670 28937 consensus_queue.cc:1048] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:12.066879 28662 tablet_bootstrap.cc:492] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:12.067310 28662 ts_tablet_manager.cc:1403] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.005s
I20260928 07:56:12.069861 28667 tablet_bootstrap.cc:492] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:12.070420 28667 ts_tablet_manager.cc:1403] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.059s user 0.007s sys 0.004s
I20260928 07:56:12.076015 28662 raft_consensus.cc:359] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.076696 28662 raft_consensus.cc:385] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.076967 28662 raft_consensus.cc:740] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.076225 28667 raft_consensus.cc:359] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.079600 27826 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 70) took 5448 ms. Trace:
I20260928 07:56:12.078030 28667 raft_consensus.cc:385] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.079948 27826 rpcz_store.cc:276] 0928 07:56:06.631160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:06.631395 (+ 235us) service_pool.cc:224] Handling call
0928 07:56:10.437108 (+3805713us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:11.994570 (+1557462us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:12.078523 (+ 83953us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:12.079532 (+ 1009us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":146,"Hive Metastore.run_cpu_time_us":2038,"Hive Metastore.run_wall_time_us":479948}
I20260928 07:56:12.080878 28667 raft_consensus.cc:740] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.081821 27826 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_24b63d04506b49d6b8b529558de57186"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:12.125186 28936 consensus_queue.cc:1048] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:12.131495 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 87192a995cc84d5eade9c917de6b2b81 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.132558 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87192a995cc84d5eade9c917de6b2b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.133754 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 87192a995cc84d5eade9c917de6b2b81 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.134742 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87192a995cc84d5eade9c917de6b2b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.159674 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet e3f2a6f83c8049628fe946a9d45152c5
I20260928 07:56:12.161804 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet e3f2a6f83c8049628fe946a9d45152c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:12.156858 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 87192a995cc84d5eade9c917de6b2b81 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.163053 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87192a995cc84d5eade9c917de6b2b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.163555 28656 tablet_replica.cc:333] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:12.164364 28656 raft_consensus.cc:2243] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:12.164898 28656 raft_consensus.cc:2272] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.165406 27822 catalog_manager.cc:6934] ReplaceTablet: tablet e3f2a6f83c8049628fe946a9d45152c5 deleted and replaced by tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5
I20260928 07:56:12.165838 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet e3f2a6f83c8049628fe946a9d45152c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:12.166543 28658 tablet_replica.cc:333] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:12.167301 28658 raft_consensus.cc:2243] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:12.167773 28658 raft_consensus.cc:2272] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.168804 28656 ts_tablet_manager.cc:1916] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.169450 28658 ts_tablet_manager.cc:1916] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.169948 27822 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_f203729d2d3041b290a7ab286fa28365"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:12.175124 27827 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_66df2d021af141bf9af764fb609f0941 [id=88fa2ddd307e49ab85b4eaa911b6669b]
I20260928 07:56:12.181666 28666 tablet_bootstrap.cc:492] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:12.163939 28328 tablet_service.cc:1558] Processing DeleteTablet for tablet e3f2a6f83c8049628fe946a9d45152c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:12.187633 28666 tablet_bootstrap.cc:654] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:12.187848 27823 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 2aac87ee995c415f8c4151ca1b926b10
I20260928 07:56:12.189741 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 2aac87ee995c415f8c4151ca1b926b10 with delete_type TABLET_DATA_DELETED (replaced by tablet 0099ff638ea34b8c8497f0193e51ad7d) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:12.192050 27823 catalog_manager.cc:6934] ReplaceTablet: tablet 2aac87ee995c415f8c4151ca1b926b10 deleted and replaced by tablet 0099ff638ea34b8c8497f0193e51ad7d
I20260928 07:56:12.197476 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 2aac87ee995c415f8c4151ca1b926b10 with delete_type TABLET_DATA_DELETED (replaced by tablet 0099ff638ea34b8c8497f0193e51ad7d) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:12.198048 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 2aac87ee995c415f8c4151ca1b926b10 with delete_type TABLET_DATA_DELETED (replaced by tablet 0099ff638ea34b8c8497f0193e51ad7d) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:12.181799 28662 consensus_queue.cc:260] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.201556 28987 raft_consensus.cc:493] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:12.201996 28987 raft_consensus.cc:515] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.204480 28666 tablet_bootstrap.cc:492] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:12.204909 28666 ts_tablet_manager.cc:1403] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.004s
I20260928 07:56:12.205869 28987 leader_election.cc:290] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:12.207376 28666 raft_consensus.cc:359] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.208007 28666 raft_consensus.cc:385] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.207734 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aac87ee995c415f8c4151ca1b926b10" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:12.208261 28666 raft_consensus.cc:740] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.208858 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aac87ee995c415f8c4151ca1b926b10" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:12.209559 28497 raft_consensus.cc:2468] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:12.210652 28141 leader_election.cc:304] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:12.211545 28987 raft_consensus.cc:2804] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:12.212071 28987 raft_consensus.cc:493] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:12.212468 28987 raft_consensus.cc:3060] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:12.213598 28658 ts_tablet_manager.cc:1929] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:12.219483 28987 raft_consensus.cc:515] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.222235 28667 consensus_queue.cc:260] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.223207 28349 raft_consensus.cc:2468] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:12.226378 28662 ts_tablet_manager.cc:1434] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.159s user 0.009s sys 0.000s
I20260928 07:56:12.214157 28666 consensus_queue.cc:260] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.229696 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aac87ee995c415f8c4151ca1b926b10" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:12.230374 28349 raft_consensus.cc:3060] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:12.234464 28666 ts_tablet_manager.cc:1434] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260928 07:56:12.235627 28658 log.cc:1199] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/e3f2a6f83c8049628fe946a9d45152c5
I20260928 07:56:12.236330 28658 ts_tablet_manager.cc:1950] T e3f2a6f83c8049628fe946a9d45152c5 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:12.239095 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet e3f2a6f83c8049628fe946a9d45152c5 (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
I20260928 07:56:12.245612 28658 tablet_replica.cc:333] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:12.246558 28658 raft_consensus.cc:2243] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:12.247084 28658 raft_consensus.cc:2272] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.248152 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aac87ee995c415f8c4151ca1b926b10" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:12.249517 28658 ts_tablet_manager.cc:1916] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:12.254446 27815 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2aac87ee995c415f8c4151ca1b926b10 consensus state has no leader
I20260928 07:56:12.252965 27828 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_2f6a2670bc2641a2b325d75d83c5db8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:12.271580 29041 tablet_replica.cc:333] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
W20260928 07:56:12.249960 28141 leader_election.cc:343] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:12.276827 28184 tablet_service.cc:1511] Processing CreateTablet for tablet f942bd0b3bbc4d908633722e32bf11b8 (DEFAULT_TABLE table=default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.277848 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f942bd0b3bbc4d908633722e32bf11b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.277047 27823 catalog_manager.cc:5838] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:12.286651 27821 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_0c6b380af93d44238ab04f5fce282fbf" } new_table_name: "default.Table_dc4f70aae79849ffaa203b8cc751126e" modify_external_catalogs: true
I20260928 07:56:12.293514 28658 ts_tablet_manager.cc:1929] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:12.293880 28658 log.cc:1199] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/2aac87ee995c415f8c4151ca1b926b10
I20260928 07:56:12.294485 28658 ts_tablet_manager.cc:1950] T 2aac87ee995c415f8c4151ca1b926b10 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:12.253508 28987 leader_election.cc:290] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:12.296940 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:12.304524 28328 tablet_service.cc:1511] Processing CreateTablet for tablet f942bd0b3bbc4d908633722e32bf11b8 (DEFAULT_TABLE table=default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.306162 28328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f942bd0b3bbc4d908633722e32bf11b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.304803 29041 raft_consensus.cc:2243] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:12.316154 29041 raft_consensus.cc:2272] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.318181 29041 ts_tablet_manager.cc:1916] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.297883 28349 raft_consensus.cc:2468] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:12.328464 28667 ts_tablet_manager.cc:1434] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.258s user 0.007s sys 0.000s
I20260928 07:56:12.330397 28142 leader_election.cc:304] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:12.336033 28656 ts_tablet_manager.cc:1929] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:12.336632 28656 log.cc:1199] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/e3f2a6f83c8049628fe946a9d45152c5
I20260928 07:56:12.337423 28656 ts_tablet_manager.cc:1950] T e3f2a6f83c8049628fe946a9d45152c5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:12.340443 28987 raft_consensus.cc:2804] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:12.341655 28987 raft_consensus.cc:697] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:12.342500 28987 consensus_queue.cc:237] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.348917 28662 tablet_bootstrap.cc:492] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:12.357195 28479 tablet_service.cc:1511] Processing CreateTablet for tablet f942bd0b3bbc4d908633722e32bf11b8 (DEFAULT_TABLE table=default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.358244 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f942bd0b3bbc4d908633722e32bf11b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.365532 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet e3f2a6f83c8049628fe946a9d45152c5 (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
I20260928 07:56:12.368139 27825 catalog_manager.cc:3541] renamed table default.table_c9320b8b140446b882ec239e50aabb4f [id=f5cc5d847243471fb78c00c7ff2bdbe9] in HMS: new name default.table_4406084e67ac4a3a86bbb72e9c6d569a
I20260928 07:56:12.373515 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet e3f2a6f83c8049628fe946a9d45152c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:12.376083 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.377121 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.382879 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.383872 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.385643 28667 tablet_bootstrap.cc:492] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:12.391498 28667 tablet_bootstrap.cc:654] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:12.378139 28656 tablet_replica.cc:333] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:12.401301 28656 raft_consensus.cc:2243] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:12.416579 28666 tablet_bootstrap.cc:492] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:12.417779 28656 pending_rounds.cc:70] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Trying to abort 1 pending ops.
I20260928 07:56:12.418025 28656 pending_rounds.cc:77] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224578027065344 op_type: NO_OP noop_request { }
I20260928 07:56:12.418380 28656 raft_consensus.cc:2889] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:12.418701 28656 raft_consensus.cc:2272] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.422139 28666 tablet_bootstrap.cc:654] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:12.425942 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 35e4db169e1644ad8ef3b248f2c4c586 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:12.439836 28497 raft_consensus.cc:1275] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Refusing update from remote peer 3bd67de620c94af3b7c8e3ba7d42f980: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:12.442888 28666 tablet_bootstrap.cc:492] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:12.443149 28667 tablet_bootstrap.cc:492] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:12.443297 28666 ts_tablet_manager.cc:1403] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.000s
I20260928 07:56:12.443564 28667 ts_tablet_manager.cc:1403] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.004s
I20260928 07:56:12.445607 28666 raft_consensus.cc:359] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.446204 28666 raft_consensus.cc:385] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.446053 29028 consensus_queue.cc:1048] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:12.446550 28666 raft_consensus.cc:740] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.447255 28666 consensus_queue.cc:260] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.448506 28204 raft_consensus.cc:1275] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Refusing update from remote peer 3bd67de620c94af3b7c8e3ba7d42f980: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:12.451946 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 3f0480f5920b4ffc8592407417d42d92 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:12.459028 28921 consensus_queue.cc:1048] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:12.463958 28667 raft_consensus.cc:359] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.464630 28667 raft_consensus.cc:385] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.470046 28667 raft_consensus.cc:740] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.470878 28667 consensus_queue.cc:260] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.473585 28667 ts_tablet_manager.cc:1434] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20260928 07:56:12.451946 27829 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]
I20260928 07:56:12.467877 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 35e4db169e1644ad8ef3b248f2c4c586
I20260928 07:56:12.485726 28666 ts_tablet_manager.cc:1434] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.042s user 0.006s sys 0.001s
I20260928 07:56:12.485961 27824 catalog_manager.cc:6934] ReplaceTablet: tablet 35e4db169e1644ad8ef3b248f2c4c586 deleted and replaced by tablet bbeec0005d4144a2a3b888b7dbcb5087
I20260928 07:56:12.489490 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e4db169e1644ad8ef3b248f2c4c586 with delete_type TABLET_DATA_DELETED (replaced by tablet bbeec0005d4144a2a3b888b7dbcb5087) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:12.468886 28092 catalog_manager.cc:2811] Deleting table default.table_66df2d021af141bf9af764fb609f0941 [id=88fa2ddd307e49ab85b4eaa911b6669b] in response to Hive Metastore notification log event 30
I20260928 07:56:12.490144 28658 tablet_replica.cc:333] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:12.490885 28658 raft_consensus.cc:2243] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:12.491701 28658 raft_consensus.cc:2272] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.492482 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e4db169e1644ad8ef3b248f2c4c586 with delete_type TABLET_DATA_DELETED (replaced by tablet bbeec0005d4144a2a3b888b7dbcb5087) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:12.493672 28658 ts_tablet_manager.cc:1916] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.494577 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e4db169e1644ad8ef3b248f2c4c586 with delete_type TABLET_DATA_DELETED (replaced by tablet bbeec0005d4144a2a3b888b7dbcb5087) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:12.518059 29047 tablet.cc:1751] T ac6814b6cc3642bf8cb48fe7dced6833 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 07:56:12.522171 27823 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 3f0480f5920b4ffc8592407417d42d92
I20260928 07:56:12.528039 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f0480f5920b4ffc8592407417d42d92 with delete_type TABLET_DATA_DELETED (replaced by tablet bb0392cdda8141579c2875548e59f29f) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:12.529436 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f0480f5920b4ffc8592407417d42d92 with delete_type TABLET_DATA_DELETED (replaced by tablet bb0392cdda8141579c2875548e59f29f) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:12.539775 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f0480f5920b4ffc8592407417d42d92 with delete_type TABLET_DATA_DELETED (replaced by tablet bb0392cdda8141579c2875548e59f29f) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:12.541996 29048 tablet.cc:1751] T ac6814b6cc3642bf8cb48fe7dced6833 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 07:56:12.542404 27823 catalog_manager.cc:6934] ReplaceTablet: tablet 3f0480f5920b4ffc8592407417d42d92 deleted and replaced by tablet bb0392cdda8141579c2875548e59f29f
I20260928 07:56:12.548799 28662 tablet_bootstrap.cc:700] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent opening tablet: real 0.169s user 0.000s sys 0.000s
I20260928 07:56:12.556890 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.558032 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.565151 28658 ts_tablet_manager.cc:1929] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:12.585629 28658 log.cc:1199] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/35e4db169e1644ad8ef3b248f2c4c586
I20260928 07:56:12.553822 28656 ts_tablet_manager.cc:1916] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.586416 28658 ts_tablet_manager.cc:1950] T 35e4db169e1644ad8ef3b248f2c4c586 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:12.588733 28658 tablet_replica.cc:333] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:12.589015 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 35e4db169e1644ad8ef3b248f2c4c586 (table default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]) successfully deleted
I20260928 07:56:12.601133 27820 catalog_manager.cc:2213] created HMS catalog entry for table [id=209eb88d159b41809555701a991da647]
I20260928 07:56:12.615950 28667 tablet_bootstrap.cc:492] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:12.621579 28667 tablet_bootstrap.cc:654] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:12.622093 28662 tablet_bootstrap.cc:654] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:12.633129 28658 raft_consensus.cc:2243] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:12.633909 28658 raft_consensus.cc:2272] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.636394 28658 ts_tablet_manager.cc:1916] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.691509 28667 tablet_bootstrap.cc:492] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:12.691927 28667 ts_tablet_manager.cc:1403] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.076s user 0.022s sys 0.007s
I20260928 07:56:12.692171 28092 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet d9220066aaeb4417a73707bd5679846f
I20260928 07:56:12.693991 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet d9220066aaeb4417a73707bd5679846f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:12 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:12.695149 28667 raft_consensus.cc:359] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.695876 28667 raft_consensus.cc:385] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.696125 28667 raft_consensus.cc:740] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.696695 28667 consensus_queue.cc:260] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.697131 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet d9220066aaeb4417a73707bd5679846f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:12 UTC) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:12.697238 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet d9220066aaeb4417a73707bd5679846f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:12 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:12.698582 28667 ts_tablet_manager.cc:1434] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260928 07:56:12.734025 28658 ts_tablet_manager.cc:1929] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:12.734436 28658 log.cc:1199] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/3f0480f5920b4ffc8592407417d42d92
I20260928 07:56:12.735123 28658 ts_tablet_manager.cc:1950] T 3f0480f5920b4ffc8592407417d42d92 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:12.737834 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 3f0480f5920b4ffc8592407417d42d92 (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:12.743614 27820 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 99) took 1216 ms. Trace:
I20260928 07:56:12.746393 27820 rpcz_store.cc:276] 0928 07:56:11.527039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:11.548877 (+ 21838us) service_pool.cc:224] Handling call
0928 07:56:12.046141 (+497264us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:12.084641 (+ 38500us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:12.601090 (+516449us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:12.656059 (+ 54969us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:12.743244 (+ 87185us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:12.743546 (+ 302us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:12.603096 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:12.603500 (+ 404us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:12.603525 (+ 25us) write_op.cc:435] Acquired schema lock
0928 07:56:12.603537 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:12.603813 (+ 276us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:12.603855 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:12.603878 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:12.604081 (+ 203us) tablet.cc:701] Row locks acquired
0928 07:56:12.604095 (+ 14us) write_op.cc:260] PREPARE: finished
0928 07:56:12.604215 (+ 120us) write_op.cc:270] Start()
0928 07:56:12.604299 (+ 84us) write_op.cc:276] Timestamp: P: 1790582172604173 usec, L: 0
0928 07:56:12.604315 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 07:56:12.604814 (+ 499us) log.cc:844] Serialized 433 byte log entry
0928 07:56:12.654174 (+ 49360us) op_driver.cc:464] REPLICATION: finished
0928 07:56:12.654505 (+ 331us) write_op.cc:301] APPLY: starting
0928 07:56:12.654554 (+ 49us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:12.654647 (+ 93us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:12.654729 (+ 82us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:12.655063 (+ 334us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:12.655179 (+ 116us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:12.655211 (+ 32us) write_op.cc:312] APPLY: finished
0928 07:56:12.655388 (+ 177us) log.cc:844] Serialized 29 byte log entry
0928 07:56:12.655523 (+ 135us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:12.655585 (+ 62us) write_op.cc:454] Released schema lock
0928 07:56:12.655612 (+ 27us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:12.655805 (+ 193us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:12.655824 (+ 19us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":372896,"Hive Metastore.run_cpu_time_us":736,"Hive Metastore.run_wall_time_us":142987,"child_traces":[["op",{"apply.queue_time_us":197,"apply.run_cpu_time_us":1273,"apply.run_wall_time_us":1274,"num_ops":2,"prepare.queue_time_us":321,"prepare.run_cpu_time_us":2017,"prepare.run_wall_time_us":3764,"raft.queue_time_us":84,"raft.run_cpu_time_us":592,"raft.run_wall_time_us":592,"replication_time_us":49768}]]}
I20260928 07:56:12.756464 28658 tablet_replica.cc:333] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:12.757251 28658 raft_consensus.cc:2243] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:12.758122 28658 raft_consensus.cc:2272] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.759864 28658 ts_tablet_manager.cc:1916] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.769768 29054 tablet.cc:1751] T ac6814b6cc3642bf8cb48fe7dced6833 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 07:56:12.777573 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 3f0480f5920b4ffc8592407417d42d92 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:12.777936 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e4db169e1644ad8ef3b248f2c4c586 with delete_type TABLET_DATA_DELETED (replaced by tablet bbeec0005d4144a2a3b888b7dbcb5087) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:12.791109 28662 tablet_bootstrap.cc:492] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:12.791692 28662 ts_tablet_manager.cc:1403] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.443s user 0.010s sys 0.001s
I20260928 07:56:12.794474 28662 raft_consensus.cc:359] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.795233 28662 raft_consensus.cc:385] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.795743 28667 tablet_bootstrap.cc:492] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:12.795562 28662 raft_consensus.cc:740] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.797168 28662 consensus_queue.cc:260] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.801129 28667 tablet_bootstrap.cc:654] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:12.813483 28666 tablet_bootstrap.cc:492] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:12.815526 29028 raft_consensus.cc:493] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:12.816025 29028 raft_consensus.cc:515] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.818145 29028 leader_election.cc:290] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:12.818596 28667 tablet_bootstrap.cc:492] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:12.818984 28667 ts_tablet_manager.cc:1403] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.001s
I20260928 07:56:12.819027 28666 tablet_bootstrap.cc:654] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:12.821025 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87192a995cc84d5eade9c917de6b2b81" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:12.821739 28497 raft_consensus.cc:2468] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:12.821413 28667 raft_consensus.cc:359] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.822646 28667 raft_consensus.cc:385] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.823014 28667 raft_consensus.cc:740] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.824052 28667 consensus_queue.cc:260] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.827113 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87192a995cc84d5eade9c917de6b2b81" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:12.828339 28666 tablet_bootstrap.cc:492] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:12.828740 28666 ts_tablet_manager.cc:1403] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.003s
I20260928 07:56:12.828913 28285 leader_election.cc:304] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
W20260928 07:56:12.830960 28286 leader_election.cc:343] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:12.831223 28666 raft_consensus.cc:359] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.831820 28666 raft_consensus.cc:385] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:12.832053 28666 raft_consensus.cc:740] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:12.832429 28921 raft_consensus.cc:2804] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:12.832754 28921 raft_consensus.cc:493] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:12.833086 28921 raft_consensus.cc:3060] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:12.838080 28656 ts_tablet_manager.cc:1929] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:12.838459 28656 log.cc:1199] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/2aac87ee995c415f8c4151ca1b926b10
I20260928 07:56:12.839164 28656 ts_tablet_manager.cc:1950] T 2aac87ee995c415f8c4151ca1b926b10 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:12.841295 28921 raft_consensus.cc:515] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.803791 27820 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]). Expected version 2 got 0
I20260928 07:56:12.843482 28667 ts_tablet_manager.cc:1434] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.024s user 0.008s sys 0.000s
I20260928 07:56:12.846876 28921 leader_election.cc:290] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:12.852376 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet af8c024a510c442caa981892d0469221 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:12.855593 28658 ts_tablet_manager.cc:1929] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:12.855975 28658 log.cc:1199] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/d9220066aaeb4417a73707bd5679846f
I20260928 07:56:12.856746 29041 ts_tablet_manager.cc:1929] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:12.857525 29041 log.cc:1199] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/e3f2a6f83c8049628fe946a9d45152c5
I20260928 07:56:12.858659 29041 ts_tablet_manager.cc:1950] T e3f2a6f83c8049628fe946a9d45152c5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:12.859280 28666 consensus_queue.cc:260] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:12.861407 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87192a995cc84d5eade9c917de6b2b81" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:12.863480 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet e3f2a6f83c8049628fe946a9d45152c5 (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
W20260928 07:56:12.863673 28286 leader_election.cc:343] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:12.860095 28658 ts_tablet_manager.cc:1950] T d9220066aaeb4417a73707bd5679846f P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:12.869283 28666 ts_tablet_manager.cc:1434] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.040s user 0.007s sys 0.001s
I20260928 07:56:12.870489 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet d9220066aaeb4417a73707bd5679846f (table default.table_66df2d021af141bf9af764fb609f0941 [id=88fa2ddd307e49ab85b4eaa911b6669b]) successfully deleted
W20260928 07:56:12.871317 27814 catalog_manager.cc:5030] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 35e4db169e1644ad8ef3b248f2c4c586 because the tablet was not found. No further retry: Not found: Tablet not found: 35e4db169e1644ad8ef3b248f2c4c586
I20260928 07:56:12.876988 29041 tablet_replica.cc:333] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:12.863049 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87192a995cc84d5eade9c917de6b2b81" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:12.879755 28497 raft_consensus.cc:3060] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:12.887364 29041 raft_consensus.cc:2243] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:12.887894 29041 raft_consensus.cc:2272] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.889722 29041 ts_tablet_manager.cc:1916] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.915189 28479 tablet_service.cc:1511] Processing CreateTablet for tablet bb0392cdda8141579c2875548e59f29f (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.916271 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0392cdda8141579c2875548e59f29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.922739 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 0099ff638ea34b8c8497f0193e51ad7d (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.923815 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0099ff638ea34b8c8497f0193e51ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.926085 28331 tablet_service.cc:1511] Processing CreateTablet for tablet bb0392cdda8141579c2875548e59f29f (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.927228 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0392cdda8141579c2875548e59f29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.929342 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet af8c024a510c442caa981892d0469221
I20260928 07:56:12.931210 27820 catalog_manager.cc:6934] ReplaceTablet: tablet af8c024a510c442caa981892d0469221 deleted and replaced by tablet c213348428a04c479f871d390b7e3c95
I20260928 07:56:12.934646 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet af8c024a510c442caa981892d0469221 with delete_type TABLET_DATA_DELETED (replaced by tablet c213348428a04c479f871d390b7e3c95) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:12.935369 28658 tablet_replica.cc:333] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:12.936084 28658 raft_consensus.cc:2243] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:12.936941 28658 raft_consensus.cc:2272] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.938913 28658 ts_tablet_manager.cc:1916] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.939321 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet af8c024a510c442caa981892d0469221 with delete_type TABLET_DATA_DELETED (replaced by tablet c213348428a04c479f871d390b7e3c95) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:12.940910 28187 tablet_service.cc:1511] Processing CreateTablet for tablet bb0392cdda8141579c2875548e59f29f (DEFAULT_TABLE table=default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.942157 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 0099ff638ea34b8c8497f0193e51ad7d (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.943388 28186 tablet_service.cc:1558] Processing DeleteTablet for tablet af8c024a510c442caa981892d0469221 with delete_type TABLET_DATA_DELETED (replaced by tablet c213348428a04c479f871d390b7e3c95) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:12.948915 28656 tablet_replica.cc:333] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:12.949697 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0392cdda8141579c2875548e59f29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.953819 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0099ff638ea34b8c8497f0193e51ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:12.962258 28656 raft_consensus.cc:2243] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:12.962831 28656 raft_consensus.cc:2272] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:12.965149 28656 ts_tablet_manager.cc:1916] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:12.972965 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
W20260928 07:56:12.973924 27815 catalog_manager.cc:5030] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet e3f2a6f83c8049628fe946a9d45152c5 because the tablet was not found. No further retry: Not found: Tablet not found: e3f2a6f83c8049628fe946a9d45152c5
I20260928 07:56:12.977821 28497 raft_consensus.cc:2468] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:12.991830 28662 ts_tablet_manager.cc:1434] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.200s user 0.006s sys 0.000s
I20260928 07:56:12.995141 28662 tablet_bootstrap.cc:492] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:13.006291 28184 tablet_service.cc:1511] Processing CreateTablet for tablet bbeec0005d4144a2a3b888b7dbcb5087 (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.007314 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeec0005d4144a2a3b888b7dbcb5087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.013742 29028 raft_consensus.cc:493] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:13.014328 29028 raft_consensus.cc:515] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.019809 29028 leader_election.cc:290] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:13.022915 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8fc8e85fc54877aa0c2afb5f3cbbc5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:13.024320 28286 leader_election.cc:343] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:13.056218 28328 tablet_service.cc:1511] Processing CreateTablet for tablet bbeec0005d4144a2a3b888b7dbcb5087 (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.058049 28328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeec0005d4144a2a3b888b7dbcb5087. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:13.069473 29054 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.268s user 0.000s sys 0.000s
I20260928 07:56:12.978900 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 0099ff638ea34b8c8497f0193e51ad7d (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:12.996395 28477 tablet_service.cc:1511] Processing CreateTablet for tablet bbeec0005d4144a2a3b888b7dbcb5087 (DEFAULT_TABLE table=default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.079450 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeec0005d4144a2a3b888b7dbcb5087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.020259 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8fc8e85fc54877aa0c2afb5f3cbbc5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:13.080955 28499 raft_consensus.cc:2468] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:13.082409 28285 leader_election.cc:304] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:13.083743 28285 leader_election.cc:304] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:13.084751 29028 raft_consensus.cc:2804] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:13.085427 28921 raft_consensus.cc:2804] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:13.085729 28921 raft_consensus.cc:493] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:13.086045 28921 raft_consensus.cc:3060] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:13.090581 29028 raft_consensus.cc:697] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:13.091457 29028 consensus_queue.cc:237] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.130972 28662 tablet_bootstrap.cc:654] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.131494 29066 tablet.cc:1751] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:13.143225 29028 consensus_queue.cc:1048] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260928 07:56:13.150374 29041 ts_tablet_manager.cc:1929] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:13.150981 29041 log.cc:1199] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/2aac87ee995c415f8c4151ca1b926b10
I20260928 07:56:13.151795 29041 ts_tablet_manager.cc:1950] T 2aac87ee995c415f8c4151ca1b926b10 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:13.152822 29068 tablet.cc:1751] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:13.154728 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:13.155366 28921 raft_consensus.cc:515] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.180610 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8fc8e85fc54877aa0c2afb5f3cbbc5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:13.181208 28498 raft_consensus.cc:3060] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:13.189493 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8fc8e85fc54877aa0c2afb5f3cbbc5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
W20260928 07:56:13.194099 28286 leader_election.cc:343] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:13.197333 27824 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_d8257603a177421fb0fbc39534fb7e0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:13.208997 28667 tablet_bootstrap.cc:492] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:13.215624 28667 tablet_bootstrap.cc:654] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.220157 28921 leader_election.cc:290] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:13.239601 28662 tablet_bootstrap.cc:492] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:13.240046 28662 ts_tablet_manager.cc:1403] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.246s user 0.007s sys 0.003s
I20260928 07:56:13.244184 29028 raft_consensus.cc:493] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:13.245267 29028 raft_consensus.cc:515] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.247396 28204 raft_consensus.cc:3060] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:13.252508 28656 ts_tablet_manager.cc:1929] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:13.256994 28666 tablet_bootstrap.cc:492] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:13.258416 28656 log.cc:1199] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/35e4db169e1644ad8ef3b248f2c4c586
I20260928 07:56:13.258872 28667 tablet_bootstrap.cc:492] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:13.259517 28667 ts_tablet_manager.cc:1403] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.051s user 0.007s sys 0.004s
I20260928 07:56:13.262594 28667 raft_consensus.cc:359] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.263257 28667 raft_consensus.cc:385] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.263509 28667 raft_consensus.cc:740] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.264262 28667 consensus_queue.cc:260] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.265378 28666 tablet_bootstrap.cc:654] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.273094 28667 ts_tablet_manager.cc:1434] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.013s user 0.002s sys 0.005s
I20260928 07:56:13.280678 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0099ff638ea34b8c8497f0193e51ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.283102 28495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f942bd0b3bbc4d908633722e32bf11b8" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:13.285627 28495 raft_consensus.cc:2468] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:13.287123 28285 leader_election.cc:304] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:13.291069 28921 raft_consensus.cc:2804] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:13.291548 28921 raft_consensus.cc:493] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:13.295404 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 7fa47d4f3bbb45f89a1750e512614b98 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:13.297525 28921 raft_consensus.cc:3060] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:13.306995 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:13.244477 29041 tablet_replica.cc:333] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:13.333083 29041 raft_consensus.cc:2243] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:13.337769 29041 raft_consensus.cc:2272] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:13.356746 28666 tablet_bootstrap.cc:492] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:13.357344 28666 ts_tablet_manager.cc:1403] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.101s user 0.010s sys 0.003s
I20260928 07:56:13.359812 28666 raft_consensus.cc:359] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.362547 29041 ts_tablet_manager.cc:1916] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:13.298096 29028 leader_election.cc:290] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:13.366477 28092 catalog_manager.cc:2811] Deleting table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321] in response to Hive Metastore notification log event 32
I20260928 07:56:13.369978 28667 tablet_bootstrap.cc:492] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:13.371412 29028 consensus_queue.cc:1048] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:13.375695 28667 tablet_bootstrap.cc:654] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.395457 28656 ts_tablet_manager.cc:1950] T 35e4db169e1644ad8ef3b248f2c4c586 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:13.392297 28667 tablet_bootstrap.cc:492] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:13.397562 28667 ts_tablet_manager.cc:1403] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.005s
I20260928 07:56:13.398779 28656 tablet_replica.cc:333] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:13.399977 28667 raft_consensus.cc:359] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.400563 28667 raft_consensus.cc:385] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.400821 28667 raft_consensus.cc:740] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.405978 28667 consensus_queue.cc:260] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.408063 28667 ts_tablet_manager.cc:1434] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.010s user 0.004s sys 0.001s
I20260928 07:56:13.418200 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 35e4db169e1644ad8ef3b248f2c4c586 (table default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]) successfully deleted
I20260928 07:56:13.419729 27823 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5
I20260928 07:56:13.422363 27823 catalog_manager.cc:6934] ReplaceTablet: tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 deleted and replaced by tablet 3b4dae7924a74f0bbdd5bfb4c34be90e
I20260928 07:56:13.434412 28666 raft_consensus.cc:385] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.434687 28666 raft_consensus.cc:740] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.434820 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 7fa47d4f3bbb45f89a1750e512614b98
I20260928 07:56:13.435457 28666 consensus_queue.cc:260] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.404459 28658 ts_tablet_manager.cc:1929] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:13.436408 28658 log.cc:1199] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/af8c024a510c442caa981892d0469221
I20260928 07:56:13.437176 28658 ts_tablet_manager.cc:1950] T af8c024a510c442caa981892d0469221 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:13.440135 28666 ts_tablet_manager.cc:1434] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.082s user 0.004s sys 0.001s
I20260928 07:56:13.274407 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f942bd0b3bbc4d908633722e32bf11b8" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:13.444955 28476 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fa47d4f3bbb45f89a1750e512614b98 with delete_type TABLET_DATA_DELETED (replaced by tablet dda49b3ac3104f47bbfc2c780282abca) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:13.445199 28656 raft_consensus.cc:2243] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:13.446097 28656 raft_consensus.cc:2272] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:13.268222 28662 raft_consensus.cc:359] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.433525 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b4dae7924a74f0bbdd5bfb4c34be90e) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:13.436942 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fa47d4f3bbb45f89a1750e512614b98 with delete_type TABLET_DATA_DELETED (replaced by tablet dda49b3ac3104f47bbfc2c780282abca) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:13.447804 28662 raft_consensus.cc:385] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.448073 28662 raft_consensus.cc:740] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.448315 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 7fa47d4f3bbb45f89a1750e512614b98 deleted and replaced by tablet dda49b3ac3104f47bbfc2c780282abca
I20260928 07:56:13.448969 28662 consensus_queue.cc:260] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.450081 28207 raft_consensus.cc:2468] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:13.452863 28662 ts_tablet_manager.cc:1434] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.213s user 0.007s sys 0.000s
I20260928 07:56:13.453807 28662 tablet_bootstrap.cc:492] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:13.407052 28498 raft_consensus.cc:2468] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:13.465070 28658 tablet_replica.cc:333] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:13.465852 28658 raft_consensus.cc:2243] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:13.466706 28658 raft_consensus.cc:2272] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:13.466702 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet af8c024a510c442caa981892d0469221 (table default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
I20260928 07:56:13.468425 28658 ts_tablet_manager.cc:1916] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:13.412773 29078 tablet.cc:1751] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:13.434055 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b4dae7924a74f0bbdd5bfb4c34be90e) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:13.494161 28666 tablet_bootstrap.cc:492] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:13.499758 28666 tablet_bootstrap.cc:654] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.508491 28662 tablet_bootstrap.cc:654] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.526012 28187 tablet_service.cc:1511] Processing CreateTablet for tablet c213348428a04c479f871d390b7e3c95 (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 07:56:13.532181 27816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260928 07:56:13.538658 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 657aa60685c740adbecdc1579270066e (DEFAULT_TABLE table=default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.518579 29051 raft_consensus.cc:493] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:13.549275 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 657aa60685c740adbecdc1579270066e (DEFAULT_TABLE table=default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.549502 29051 raft_consensus.cc:515] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.551508 29051 leader_election.cc:290] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:13.553457 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0392cdda8141579c2875548e59f29f" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:13.554898 28434 leader_election.cc:343] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:13.530042 28477 tablet_service.cc:1511] Processing CreateTablet for tablet c213348428a04c479f871d390b7e3c95 (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.563840 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657aa60685c740adbecdc1579270066e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.566846 28662 tablet_bootstrap.cc:492] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:13.567406 28662 ts_tablet_manager.cc:1403] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.114s user 0.009s sys 0.000s
I20260928 07:56:13.573630 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c213348428a04c479f871d390b7e3c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.576380 28662 raft_consensus.cc:359] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.587033 28666 tablet_bootstrap.cc:492] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:13.587530 28666 ts_tablet_manager.cc:1403] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.094s user 0.001s sys 0.009s
I20260928 07:56:13.590842 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657aa60685c740adbecdc1579270066e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.591455 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c213348428a04c479f871d390b7e3c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.585490 28662 raft_consensus.cc:385] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.593923 28662 raft_consensus.cc:740] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.594674 28662 consensus_queue.cc:260] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.595847 28285 leader_election.cc:304] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:13.590037 28666 raft_consensus.cc:359] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.597150 28666 raft_consensus.cc:385] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.597450 28666 raft_consensus.cc:740] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.598460 28666 consensus_queue.cc:260] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.599757 28662 ts_tablet_manager.cc:1434] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.032s user 0.005s sys 0.000s
W20260928 07:56:13.599659 27816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.252:41205, user_credentials={real_user=slave}} blocked reactor thread for 67567.4us
I20260928 07:56:13.612777 28666 ts_tablet_manager.cc:1434] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
W20260928 07:56:13.612937 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260928 07:56:13.528281 27823 catalog_manager.cc:5838] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:13.614814 28658 ts_tablet_manager.cc:1929] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:13.615314 28662 tablet_bootstrap.cc:492] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:13.615299 28092 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet bb0392cdda8141579c2875548e59f29f
W20260928 07:56:13.619210 27826 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_24b63d04506b49d6b8b529558de57186 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:13.621021 28662 tablet_bootstrap.cc:654] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.624446 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet bb0392cdda8141579c2875548e59f29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:13 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:13.625468 28656 ts_tablet_manager.cc:1916] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:13.621995 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet bb0392cdda8141579c2875548e59f29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:13 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:13.633152 28658 log.cc:1199] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/7fa47d4f3bbb45f89a1750e512614b98
I20260928 07:56:13.632182 28666 tablet_bootstrap.cc:492] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:13.641902 28658 ts_tablet_manager.cc:1950] T 7fa47d4f3bbb45f89a1750e512614b98 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:13.644490 28658 tablet_replica.cc:333] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:13.644774 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 7fa47d4f3bbb45f89a1750e512614b98 (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:13.647395 28666 tablet_bootstrap.cc:654] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:13.655094 27822 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f203729d2d3041b290a7ab286fa28365 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:13.657876 27827 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 95) took 2321 ms. Trace:
I20260928 07:56:13.658294 27827 rpcz_store.cc:276] 0928 07:56:11.336396 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:11.336504 (+ 108us) service_pool.cc:224] Handling call
0928 07:56:12.042646 (+706142us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:13.657630 (+1614984us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":6424,"Hive Metastore.run_cpu_time_us":329,"Hive Metastore.run_wall_time_us":124928}
I20260928 07:56:13.660729 28658 raft_consensus.cc:2243] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:13.661309 28658 raft_consensus.cc:2272] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:13.663957 27828 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2f6a2670bc2641a2b325d75d83c5db8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:13.664675 28658 ts_tablet_manager.cc:1916] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:13.668330 27825 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 94) took 2332 ms. Trace:
I20260928 07:56:13.669600 27829 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 96) took 2332 ms. Trace:
I20260928 07:56:13.670042 27829 rpcz_store.cc:276] 0928 07:56:11.336663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:11.338212 (+ 1549us) service_pool.cc:224] Handling call
0928 07:56:12.043443 (+705231us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:13.669409 (+1625966us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":323320,"Hive Metastore.run_cpu_time_us":295,"Hive Metastore.run_wall_time_us":81293}
I20260928 07:56:13.671439 27829 master_service.cc:960] ReplaceTablet: received request to replace tablet 87192a995cc84d5eade9c917de6b2b81 from {username='slave'} at 127.0.0.1:51542
W20260928 07:56:13.672775 27824 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d8257603a177421fb0fbc39534fb7e0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:13.675429 29084 raft_consensus.cc:493] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:13.676235 29084 raft_consensus.cc:515] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.668622 27825 rpcz_store.cc:276] 0928 07:56:11.336070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:11.361186 (+ 25116us) service_pool.cc:224] Handling call
0928 07:56:12.042774 (+681588us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:13.666464 (+1623690us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:13.667377 (+ 913us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:13.668140 (+ 763us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":131305,"Hive Metastore.run_cpu_time_us":1834,"Hive Metastore.run_wall_time_us":192909}
I20260928 07:56:13.679616 28666 tablet_bootstrap.cc:492] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:13.680037 28666 ts_tablet_manager.cc:1403] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.048s user 0.011s sys 0.000s
I20260928 07:56:13.686939 27825 master_service.cc:960] ReplaceTablet: received request to replace tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:13.687816 28326 tablet_service.cc:1558] Processing DeleteTablet for tablet bb0392cdda8141579c2875548e59f29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:13 UTC) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:13.690168 28327 tablet_service.cc:1511] Processing CreateTablet for tablet 657aa60685c740adbecdc1579270066e (DEFAULT_TABLE table=default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.690980 28666 raft_consensus.cc:359] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.691601 28666 raft_consensus.cc:385] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.691701 28327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657aa60685c740adbecdc1579270066e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.691879 28666 raft_consensus.cc:740] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.702862 28329 tablet_service.cc:1511] Processing CreateTablet for tablet c213348428a04c479f871d390b7e3c95 (DEFAULT_TABLE table=default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.704246 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c213348428a04c479f871d390b7e3c95. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:05.702123 28778 debug-util.cc:398] Leaking SignalData structure 0x7b08000292c0 after lost signal to thread 28655
W20260928 07:56:13.706867 28778 kernel_stack_watchdog.cc:198] Thread 28655 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 352ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260928 07:56:13.712663 28666 consensus_queue.cc:260] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:13.713771 28655 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 9.380s user 0.000s sys 0.001s
W20260928 07:56:13.714138 28655 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 9.381s user 0.000s sys 0.002s
W20260928 07:56:04.330134 28784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 07:56:13.721253 29051 raft_consensus.cc:493] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:13.721712 29051 raft_consensus.cc:515] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.723642 29051 leader_election.cc:290] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:13.725648 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec0005d4144a2a3b888b7dbcb5087" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:13.728075 28434 leader_election.cc:343] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:13.742424 28658 ts_tablet_manager.cc:1929] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:13.745009 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b4dae7924a74f0bbdd5bfb4c34be90e) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:13.746194 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fa47d4f3bbb45f89a1750e512614b98 with delete_type TABLET_DATA_DELETED (replaced by tablet dda49b3ac3104f47bbfc2c780282abca) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:13.746655 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec0005d4144a2a3b888b7dbcb5087" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:13.749125 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0392cdda8141579c2875548e59f29f" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:13.752374 28662 tablet_bootstrap.cc:492] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:13.752825 28662 ts_tablet_manager.cc:1403] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.152s user 0.012s sys 0.006s
I20260928 07:56:13.755178 28662 raft_consensus.cc:359] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.755861 28662 raft_consensus.cc:385] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.757535 28662 raft_consensus.cc:740] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.758282 28662 consensus_queue.cc:260] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.759172 29083 raft_consensus.cc:2804] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:13.762143 28662 ts_tablet_manager.cc:1434] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.009s user 0.002s sys 0.003s
I20260928 07:56:13.766225 28662 tablet_bootstrap.cc:492] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:13.734309 28666 ts_tablet_manager.cc:1434] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
W20260928 07:56:13.748997 28434 leader_election.cc:343] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:13.767838 28434 leader_election.cc:304] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:13.769308 29051 raft_consensus.cc:2749] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:13.779953 28658 log.cc:1199] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/8d8fc8e85fc54877aa0c2afb5f3cbbc5
I20260928 07:56:13.785159 28658 ts_tablet_manager.cc:1950] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:13.791594 28658 tablet_replica.cc:333] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:13.792311 28658 raft_consensus.cc:2243] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:13.792480 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
I20260928 07:56:13.792770 28658 raft_consensus.cc:2272] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:13.797931 28666 tablet_bootstrap.cc:492] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:13.800207 28662 tablet_bootstrap.cc:654] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.803922 28666 tablet_bootstrap.cc:654] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.804842 28658 ts_tablet_manager.cc:1916] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:13.806706 29051 raft_consensus.cc:493] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:13.807181 29051 raft_consensus.cc:515] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.810354 27829 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 87192a995cc84d5eade9c917de6b2b81
I20260928 07:56:13.810603 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:13.811924 27829 catalog_manager.cc:6934] ReplaceTablet: tablet 87192a995cc84d5eade9c917de6b2b81 deleted and replaced by tablet d554c2be0f2a436ab5a0a62adcadbdd3
W20260928 07:56:13.811955 28434 leader_election.cc:343] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:13.808997 29051 leader_election.cc:290] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:13.813782 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 87192a995cc84d5eade9c917de6b2b81 with delete_type TABLET_DATA_DELETED (replaced by tablet d554c2be0f2a436ab5a0a62adcadbdd3) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:13.814520 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 87192a995cc84d5eade9c917de6b2b81 with delete_type TABLET_DATA_DELETED (replaced by tablet d554c2be0f2a436ab5a0a62adcadbdd3) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:13.816748 28655 server_base.cc:1061] running on GCE node
I20260928 07:56:13.822994 28662 tablet_bootstrap.cc:492] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:13.827461 28662 ts_tablet_manager.cc:1403] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.001s
I20260928 07:56:13.830111 28662 raft_consensus.cc:359] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.830767 28662 raft_consensus.cc:385] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.831027 28662 raft_consensus.cc:740] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.841516 28662 consensus_queue.cc:260] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.847110 28662 ts_tablet_manager.cc:1434] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260928 07:56:13.848093 28662 tablet_bootstrap.cc:492] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
W20260928 07:56:13.857975 29088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 07:56:13.858662 28662 tablet_bootstrap.cc:654] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.861356 28658 ts_tablet_manager.cc:1929] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:13.861891 28658 log.cc:1199] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/bb0392cdda8141579c2875548e59f29f
I20260928 07:56:13.766949 28667 tablet_bootstrap.cc:492] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:13.420650 28921 raft_consensus.cc:515] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.773856 29028 raft_consensus.cc:493] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:13.862696 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 87192a995cc84d5eade9c917de6b2b81 with delete_type TABLET_DATA_DELETED (replaced by tablet d554c2be0f2a436ab5a0a62adcadbdd3) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:13.863893 28658 ts_tablet_manager.cc:1950] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:13.864665 28655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 07:56:13.869585 28666 tablet_bootstrap.cc:492] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:13.870025 28666 ts_tablet_manager.cc:1403] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.005s
I20260928 07:56:13.870759 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet bb0392cdda8141579c2875548e59f29f (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:13.871685 28658 tablet_replica.cc:333] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:13.872437 28658 raft_consensus.cc:2243] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:13.872349 28666 raft_consensus.cc:359] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.872987 28666 raft_consensus.cc:385] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.873025 28658 raft_consensus.cc:2272] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:13.873308 28666 raft_consensus.cc:740] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.874886 28658 ts_tablet_manager.cc:1916] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:13.887781 27829 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_995804006b294eb8a427e904cad03079" } modify_external_catalogs: true
I20260928 07:56:13.887861 28666 consensus_queue.cc:260] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.888664 27829 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_995804006b294eb8a427e904cad03079" } modify_external_catalogs: true
I20260928 07:56:13.888832 27820 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:13.889575 27825 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_457d1f751e7c405eb8466e6f18c185ac" } modify_external_catalogs: true
I20260928 07:56:13.889925 28666 ts_tablet_manager.cc:1434] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260928 07:56:13.890125 27825 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_457d1f751e7c405eb8466e6f18c185ac" } modify_external_catalogs: true
I20260928 07:56:13.893191 28921 leader_election.cc:290] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:13.863529 28351 raft_consensus.cc:2468] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:13.894955 28666 tablet_bootstrap.cc:492] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:13.895553 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:13.900709 28666 tablet_bootstrap.cc:654] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.900892 28434 leader_election.cc:304] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
W20260928 07:56:13.901464 28434 raft_consensus.cc:2686] T bb0392cdda8141579c2875548e59f29f P bae11841a62f429a98a978de5b7bd60e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 07:56:13.901523 28658 ts_tablet_manager.cc:1929] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:13.901893 28658 log.cc:1199] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/87192a995cc84d5eade9c917de6b2b81
I20260928 07:56:13.903093 28658 ts_tablet_manager.cc:1950] T 87192a995cc84d5eade9c917de6b2b81 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:13.904637 27823 catalog_manager.cc:6391] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9] alter complete (version 1)
I20260928 07:56:13.904776 29026 raft_consensus.cc:493] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:13.905244 29026 raft_consensus.cc:515] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:13.868148 28285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 66313.9us
I20260928 07:56:13.907358 29026 leader_election.cc:290] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:13.907310 27827 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_84e7371229d1457d92d342b6b4e36a16" } new_table_name: "default.Table_2519a070e9974faeb26f6bcd4756d344" modify_external_catalogs: true
I20260928 07:56:13.863051 29028 raft_consensus.cc:515] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.909320 29028 leader_election.cc:290] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:13.912459 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.913456 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.913367 28349 raft_consensus.cc:2468] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:13.913640 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 87192a995cc84d5eade9c917de6b2b81 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
I20260928 07:56:13.918516 29041 ts_tablet_manager.cc:1929] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:13.919080 29041 log.cc:1199] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/35e4db169e1644ad8ef3b248f2c4c586
I20260928 07:56:13.919750 28656 ts_tablet_manager.cc:1929] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:13.920107 28656 log.cc:1199] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/3f0480f5920b4ffc8592407417d42d92
I20260928 07:56:13.920809 28656 ts_tablet_manager.cc:1950] T 3f0480f5920b4ffc8592407417d42d92 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:13.922793 28656 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54230 (request call id 142) took 1395 ms. Trace:
I20260928 07:56:13.923141 28656 rpcz_store.cc:276] 0928 07:56:12.527757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.527901 (+ 144us) service_pool.cc:224] Handling call
0928 07:56:13.398629 (+870728us) ts_tablet_manager.cc:1151] Deleting tablet 3f0480f5920b4ffc8592407417d42d92
0928 07:56:13.398672 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:13.765409 (+366737us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:13.919629 (+154220us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:13.922738 (+ 3109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":870154}
I20260928 07:56:13.923503 28434 leader_election.cc:304] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:13.924211 29051 raft_consensus.cc:2804] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:13.924401 28656 tablet_replica.cc:333] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:13.924535 29051 raft_consensus.cc:493] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:13.924837 29051 raft_consensus.cc:3060] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:13.925208 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:13.921414 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:13.926548 28496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f942bd0b3bbc4d908633722e32bf11b8" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:13.926819 28349 raft_consensus.cc:2468] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:13.927071 28496 raft_consensus.cc:3060] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:13.929569 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:13.931260 28667 tablet_bootstrap.cc:654] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:13.933688 28142 leader_election.cc:304] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:13.937585 28655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 07:56:13.938053 29026 raft_consensus.cc:2804] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:13.938254 28662 tablet_bootstrap.cc:492] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:13.938519 29026 raft_consensus.cc:493] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:13.938680 28662 ts_tablet_manager.cc:1403] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.091s user 0.008s sys 0.001s
I20260928 07:56:13.940757 29026 raft_consensus.cc:3060] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:13.941872 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.941123 28662 raft_consensus.cc:359] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.943544 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.943799 28662 raft_consensus.cc:385] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:13.944072 28662 raft_consensus.cc:740] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:13.944736 28662 consensus_queue.cc:260] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.925110 28656 raft_consensus.cc:2243] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:13.946146 28656 raft_consensus.cc:2272] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:13.948143 28656 ts_tablet_manager.cc:1916] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:13.951972 28496 raft_consensus.cc:2468] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:13.959864 28285 leader_election.cc:304] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:13.960078 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e (DEFAULT_TABLE table=default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:13.961297 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:13.954494 29051 raft_consensus.cc:515] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.965704 28921 raft_consensus.cc:2804] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:13.966180 28498 raft_consensus.cc:2393] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate acdaa3cf2ffd45f5b55a169c1bacead5 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:13.966177 28921 raft_consensus.cc:697] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:13.966923 28921 consensus_queue.cc:237] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.970506 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:13.976567 29051 leader_election.cc:290] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:13.978084 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:13.978680 28349 raft_consensus.cc:3060] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:13.978233 29026 raft_consensus.cc:515] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:13.979727 28207 raft_consensus.cc:2393] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:13.989914 29041 ts_tablet_manager.cc:1950] T 35e4db169e1644ad8ef3b248f2c4c586 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:13.990543 28662 ts_tablet_manager.cc:1434] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.052s user 0.009s sys 0.005s
I20260928 07:56:13.991379 28662 tablet_bootstrap.cc:492] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:13.993162 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 127) took 1501 ms. Trace:
I20260928 07:56:13.996932 28662 tablet_bootstrap.cc:654] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.000265 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:14.001017 28498 raft_consensus.cc:2393] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate acdaa3cf2ffd45f5b55a169c1bacead5 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:14.002300 29026 leader_election.cc:290] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:14.009768 28666 tablet_bootstrap.cc:492] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:14.010217 28666 ts_tablet_manager.cc:1403] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.115s user 0.024s sys 0.017s
I20260928 07:56:14.012728 28666 raft_consensus.cc:359] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.013399 28666 raft_consensus.cc:385] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.013703 28666 raft_consensus.cc:740] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.015405 28656 ts_tablet_manager.cc:1929] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:14.015761 28656 log.cc:1199] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/d9220066aaeb4417a73707bd5679846f
I20260928 07:56:14.016462 28656 ts_tablet_manager.cc:1950] T d9220066aaeb4417a73707bd5679846f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:14.017208 28656 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54230 (request call id 143) took 1321 ms. Trace:
I20260928 07:56:14.017524 28656 rpcz_store.cc:276] 0928 07:56:12.695609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.697077 (+ 1468us) service_pool.cc:224] Handling call
0928 07:56:13.924245 (+1227168us) ts_tablet_manager.cc:1151] Deleting tablet d9220066aaeb4417a73707bd5679846f
0928 07:56:13.924285 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:13.998528 (+ 74243us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:14.015280 (+ 16752us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:14.017159 (+ 1879us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226621}
I20260928 07:56:14.018575 28656 tablet_replica.cc:333] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:14.019273 28656 raft_consensus.cc:2243] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.019730 28656 raft_consensus.cc:2272] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.021111 28666 consensus_queue.cc:260] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.023105 28666 ts_tablet_manager.cc:1434] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.013s user 0.004s sys 0.002s
I20260928 07:56:14.029687 28656 ts_tablet_manager.cc:1916] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.031167 28662 tablet_bootstrap.cc:492] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:14.031621 28662 ts_tablet_manager.cc:1403] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.000s
I20260928 07:56:14.033464 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet bb0392cdda8141579c2875548e59f29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:13 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:14.034222 28662 raft_consensus.cc:359] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.034907 28662 raft_consensus.cc:385] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.035152 28662 raft_consensus.cc:740] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.035868 28662 consensus_queue.cc:260] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:14.039389 27814 catalog_manager.cc:5030] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet bb0392cdda8141579c2875548e59f29f because the tablet was not found. No further retry: Not found: Tablet not found: bb0392cdda8141579c2875548e59f29f
I20260928 07:56:13.998787 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:13.905649 29083 raft_consensus.cc:697] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
W20260928 07:56:14.005051 28285 leader_election.cc:343] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Not found: Tablet not found: bb0392cdda8141579c2875548e59f29f
I20260928 07:56:14.043223 28142 leader_election.cc:304] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:14.051630 29026 raft_consensus.cc:2749] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 07:56:14.054018 29097 raft_consensus.cc:493] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:14.054472 29097 raft_consensus.cc:515] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.054863 29083 consensus_queue.cc:237] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.056432 29097 leader_election.cc:290] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:14.056926 28662 ts_tablet_manager.cc:1434] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260928 07:56:14.005465 29084 leader_election.cc:290] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:14.026412 28667 tablet_bootstrap.cc:492] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:14.060503 28667 ts_tablet_manager.cc:1403] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.294s user 0.006s sys 0.007s
I20260928 07:56:14.064616 28667 raft_consensus.cc:359] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.065305 28667 raft_consensus.cc:385] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.065563 28667 raft_consensus.cc:740] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.066282 28667 consensus_queue.cc:260] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.066584 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c213348428a04c479f871d390b7e3c95" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:14.068324 28667 ts_tablet_manager.cc:1434] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260928 07:56:14.060137 28662 tablet_bootstrap.cc:492] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
W20260928 07:56:14.070042 28434 leader_election.cc:343] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: c213348428a04c479f871d390b7e3c95
I20260928 07:56:14.041114 29041 rpcz_store.cc:276] 0928 07:56:12.492178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.492329 (+ 151us) service_pool.cc:224] Handling call
0928 07:56:13.244285 (+751956us) ts_tablet_manager.cc:1151] Deleting tablet 35e4db169e1644ad8ef3b248f2c4c586
0928 07:56:13.244352 (+ 67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:13.481380 (+237028us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:13.918265 (+436885us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:13.993065 (+ 74800us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":751408}
W20260928 07:56:14.070936 28434 leader_election.cc:343] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:14.072043 28434 leader_election.cc:304] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:14.072947 29097 raft_consensus.cc:2749] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:14.073349 29041 tablet_replica.cc:333] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:14.077207 28662 tablet_bootstrap.cc:654] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.077441 28655 hybrid_clock.cc:648] HybridClock initialized: now 1790582174077254 us; error 222 us; skew 500 ppm
I20260928 07:56:14.078744 28655 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 07:56:14.088127 28656 ts_tablet_manager.cc:1929] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:14.088534 28656 log.cc:1199] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/af8c024a510c442caa981892d0469221
I20260928 07:56:14.089347 28656 ts_tablet_manager.cc:1950] T af8c024a510c442caa981892d0469221 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:14.093827 28656 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54230 (request call id 146) took 1153 ms. Trace:
I20260928 07:56:14.094223 28656 rpcz_store.cc:276] 0928 07:56:12.940171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.943155 (+ 2984us) service_pool.cc:224] Handling call
0928 07:56:14.018439 (+1075284us) ts_tablet_manager.cc:1151] Deleting tablet af8c024a510c442caa981892d0469221
0928 07:56:14.018478 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:14.051925 (+ 33447us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:14.087992 (+ 36067us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:14.093758 (+ 5766us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1074652}
W20260928 07:56:14.097329 27820 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0099ff638ea34b8c8497f0193e51ad7d consensus state has no leader
I20260928 07:56:14.096019 28662 tablet_bootstrap.cc:492] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:14.098065 28662 ts_tablet_manager.cc:1403] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.040s user 0.014s sys 0.000s
I20260928 07:56:14.098498 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet 608a4d03b3e341a2898ce42d86288d54 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:14.100629 28662 raft_consensus.cc:359] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.101444 28662 raft_consensus.cc:385] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.101711 28662 raft_consensus.cc:740] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.102730 28656 tablet_replica.cc:333] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:14.103820 28656 raft_consensus.cc:2243] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.104414 28656 raft_consensus.cc:2272] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.106381 28656 ts_tablet_manager.cc:1916] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:14.115820 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0099ff638ea34b8c8497f0193e51ad7d consensus state has no leader
I20260928 07:56:14.115896 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f942bd0b3bbc4d908633722e32bf11b8" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:14.116444 28204 raft_consensus.cc:3060] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.117206 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0099ff638ea34b8c8497f0193e51ad7d" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:14.117945 28205 raft_consensus.cc:2393] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bd67de620c94af3b7c8e3ba7d42f980 in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:14.103513 28662 consensus_queue.cc:260] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.119940 28662 ts_tablet_manager.cc:1434] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260928 07:56:14.120855 28662 tablet_bootstrap.cc:492] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:14.123446 29026 raft_consensus.cc:493] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:14.123888 29026 raft_consensus.cc:515] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.126168 28204 raft_consensus.cc:2468] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:14.126704 29026 leader_election.cc:290] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:14.128278 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0392cdda8141579c2875548e59f29f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:14.128880 28205 raft_consensus.cc:2468] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
W20260928 07:56:14.130350 28142 leader_election.cc:343] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 657aa60685c740adbecdc1579270066e
I20260928 07:56:14.131449 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657aa60685c740adbecdc1579270066e" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:14.132041 28498 raft_consensus.cc:2468] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:14.133263 28141 leader_election.cc:304] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:14.134248 29026 raft_consensus.cc:2804] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:14.134613 29026 raft_consensus.cc:493] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:14.134989 29026 raft_consensus.cc:3060] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.138690 28662 tablet_bootstrap.cc:654] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.141863 28656 ts_tablet_manager.cc:1929] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:14.142282 28656 log.cc:1199] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/7fa47d4f3bbb45f89a1750e512614b98
I20260928 07:56:14.142978 28656 ts_tablet_manager.cc:1950] T 7fa47d4f3bbb45f89a1750e512614b98 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:14.145378 28656 tablet_replica.cc:333] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:14.146824 28286 leader_election.cc:304] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:14.149107 28286 leader_election.cc:304] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:14.150311 28921 raft_consensus.cc:2804] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:14.150449 28656 raft_consensus.cc:2243] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.150530 28349 raft_consensus.cc:2468] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:14.150730 28921 raft_consensus.cc:493] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:14.150928 28656 raft_consensus.cc:2272] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.141863 29026 raft_consensus.cc:515] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.151191 28921 raft_consensus.cc:3060] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.151767 28434 leader_election.cc:304] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:14.152280 29083 raft_consensus.cc:2749] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:14.153142 29026 leader_election.cc:290] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:14.153900 29097 raft_consensus.cc:2804] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:14.018852 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet d9220066aaeb4417a73707bd5679846f (table default.table_66df2d021af141bf9af764fb609f0941 [id=88fa2ddd307e49ab85b4eaa911b6669b]) successfully deleted
I20260928 07:56:14.154306 29097 raft_consensus.cc:697] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
W20260928 07:56:14.154366 27815 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 135537us
I20260928 07:56:14.154886 28656 ts_tablet_manager.cc:1916] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.155040 29097 consensus_queue.cc:237] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.155717 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 35e4db169e1644ad8ef3b248f2c4c586 (table default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6]) successfully deleted
I20260928 07:56:14.156724 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet af8c024a510c442caa981892d0469221 (table default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
I20260928 07:56:14.157429 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 7fa47d4f3bbb45f89a1750e512614b98 (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:14.159371 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657aa60685c740adbecdc1579270066e" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:14.159893 28498 raft_consensus.cc:3060] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.167723 28498 raft_consensus.cc:2468] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:14.081375 29041 raft_consensus.cc:2243] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.169847 29041 raft_consensus.cc:2272] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.172365 29041 ts_tablet_manager.cc:1916] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.173980 28141 leader_election.cc:304] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:14.174700 28662 tablet_bootstrap.cc:492] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:14.175108 28662 ts_tablet_manager.cc:1403] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.003s
I20260928 07:56:14.179204 28662 raft_consensus.cc:359] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.174865 29026 raft_consensus.cc:2804] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:14.184643 29026 raft_consensus.cc:697] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:14.185588 29026 consensus_queue.cc:237] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:14.186265 28142 leader_election.cc:343] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 657aa60685c740adbecdc1579270066e
I20260928 07:56:14.189358 28667 tablet_bootstrap.cc:492] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:14.179850 28662 raft_consensus.cc:385] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.191377 28662 raft_consensus.cc:740] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.192265 28477 tablet_service.cc:1511] Processing CreateTablet for tablet dda49b3ac3104f47bbfc2c780282abca (DEFAULT_TABLE table=default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.192147 28662 consensus_queue.cc:260] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.193480 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda49b3ac3104f47bbfc2c780282abca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.194377 28662 ts_tablet_manager.cc:1434] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.017s user 0.001s sys 0.005s
I20260928 07:56:14.195160 28921 raft_consensus.cc:515] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.201179 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0392cdda8141579c2875548e59f29f" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:14.201741 28205 raft_consensus.cc:3060] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:14.203018 28285 leader_election.cc:343] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Not found: Tablet not found: bb0392cdda8141579c2875548e59f29f
I20260928 07:56:14.205965 28187 tablet_service.cc:1511] Processing CreateTablet for tablet dda49b3ac3104f47bbfc2c780282abca (DEFAULT_TABLE table=default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.206971 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda49b3ac3104f47bbfc2c780282abca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.215958 28656 ts_tablet_manager.cc:1929] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:14.216338 28656 log.cc:1199] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/8d8fc8e85fc54877aa0c2afb5f3cbbc5
I20260928 07:56:14.216933 28656 ts_tablet_manager.cc:1950] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:14.216997 28205 raft_consensus.cc:2468] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:14.218779 28667 tablet_bootstrap.cc:654] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.223960 28666 tablet_bootstrap.cc:492] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:14.229799 28666 tablet_bootstrap.cc:654] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.234803 28329 tablet_service.cc:1511] Processing CreateTablet for tablet dda49b3ac3104f47bbfc2c780282abca (DEFAULT_TABLE table=default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 07:56:14.235229 28285 consensus_peers.cc:597] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 -> Peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Couldn't send request to peer bae11841a62f429a98a978de5b7bd60e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87192a995cc84d5eade9c917de6b2b81. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:14.236318 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda49b3ac3104f47bbfc2c780282abca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.230196 28656 tablet_replica.cc:333] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:14.236557 28204 raft_consensus.cc:3060] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.237347 28656 raft_consensus.cc:2243] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.237795 28656 raft_consensus.cc:2272] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.243499 28656 ts_tablet_manager.cc:1916] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.253559 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
I20260928 07:56:14.258737 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 608a4d03b3e341a2898ce42d86288d54
I20260928 07:56:14.237335 28921 leader_election.cc:290] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:14.237530 28286 leader_election.cc:304] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:14.264608 28667 tablet_bootstrap.cc:492] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:14.264724 29084 raft_consensus.cc:2804] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:14.265069 28667 ts_tablet_manager.cc:1403] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.076s user 0.010s sys 0.000s
I20260928 07:56:14.265152 29084 raft_consensus.cc:697] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:14.266012 29084 consensus_queue.cc:237] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.267004 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 608a4d03b3e341a2898ce42d86288d54 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ec9ebafa7c248ceb280587e49d964b7) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:14.267515 28667 raft_consensus.cc:359] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.268168 28667 raft_consensus.cc:385] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.268465 28667 raft_consensus.cc:740] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.269459 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 608a4d03b3e341a2898ce42d86288d54 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ec9ebafa7c248ceb280587e49d964b7) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:14.262321 27823 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:14.270848 28658 tablet_replica.cc:333] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:14.278632 29026 raft_consensus.cc:493] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:14.279203 29026 raft_consensus.cc:515] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.281615 28662 tablet_bootstrap.cc:492] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:14.285055 29026 leader_election.cc:290] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
W20260928 07:56:14.286604 28141 leader_election.cc:343] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Not found: Tablet not found: 87192a995cc84d5eade9c917de6b2b81
I20260928 07:56:14.293452 27820 catalog_manager.cc:6934] ReplaceTablet: tablet 608a4d03b3e341a2898ce42d86288d54 deleted and replaced by tablet 7ec9ebafa7c248ceb280587e49d964b7
I20260928 07:56:14.304612 28655 webserver.cc:533] Webserver started at http://127.26.221.252:40429/ using document root <none> and password file <none>
I20260928 07:56:14.306270 28655 fs_manager.cc:362] Metadata directory not provided
I20260928 07:56:14.309186 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b4dae7924a74f0bbdd5bfb4c34be90e) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:14.311604 28658 raft_consensus.cc:2243] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.312170 28658 raft_consensus.cc:2272] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.318988 28666 tablet_bootstrap.cc:492] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:14.319460 28666 ts_tablet_manager.cc:1403] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.096s user 0.014s sys 0.002s
I20260928 07:56:14.321996 28666 raft_consensus.cc:359] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.330643 28666 raft_consensus.cc:385] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.331002 28666 raft_consensus.cc:740] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.331928 28666 consensus_queue.cc:260] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.334569 28666 ts_tablet_manager.cc:1434] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260928 07:56:14.335135 28656 ts_tablet_manager.cc:1929] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:14.335553 28656 log.cc:1199] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/bb0392cdda8141579c2875548e59f29f
I20260928 07:56:14.336205 28187 tablet_service.cc:1511] Processing CreateTablet for tablet d554c2be0f2a436ab5a0a62adcadbdd3 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.336855 28666 tablet_bootstrap.cc:492] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:14.337152 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d554c2be0f2a436ab5a0a62adcadbdd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.337464 28655 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 07:56:14.336225 28656 ts_tablet_manager.cc:1950] T bb0392cdda8141579c2875548e59f29f P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:14.341536 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet bb0392cdda8141579c2875548e59f29f (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:14.342511 28656 tablet_replica.cc:333] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:14.332988 28658 ts_tablet_manager.cc:1916] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.354215 28662 tablet_bootstrap.cc:654] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.356504 28656 raft_consensus.cc:2243] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.268364 29028 consensus_queue.cc:1048] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:14.357304 28656 raft_consensus.cc:2272] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.268334 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 608a4d03b3e341a2898ce42d86288d54 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ec9ebafa7c248ceb280587e49d964b7) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:14.242589 29083 raft_consensus.cc:493] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:14.359263 29083 raft_consensus.cc:515] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.361084 28666 tablet_bootstrap.cc:654] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.361491 29083 leader_election.cc:290] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:14.363644 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec0005d4144a2a3b888b7dbcb5087" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:14.283258 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87192a995cc84d5eade9c917de6b2b81" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:14.364300 28205 raft_consensus.cc:2468] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:14.364588 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec0005d4144a2a3b888b7dbcb5087" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:14.365204 28498 raft_consensus.cc:2468] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:14.365861 28286 leader_election.cc:304] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:14.366185 28142 leader_election.cc:304] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
W20260928 07:56:14.366792 28286 consensus_peers.cc:597] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260928 07:56:14.366715 28142 raft_consensus.cc:2686] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 07:56:14.366701 28656 ts_tablet_manager.cc:1916] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.368360 29083 raft_consensus.cc:2804] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:14.368829 29083 raft_consensus.cc:493] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:14.369187 29083 raft_consensus.cc:3060] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.369908 28331 tablet_service.cc:1511] Processing CreateTablet for tablet d554c2be0f2a436ab5a0a62adcadbdd3 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.371014 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d554c2be0f2a436ab5a0a62adcadbdd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.375094 29026 raft_consensus.cc:493] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:14.375717 29026 raft_consensus.cc:515] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.378914 29026 leader_election.cc:290] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:14.379179 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c213348428a04c479f871d390b7e3c95" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:14.379777 28498 raft_consensus.cc:2468] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:14.381102 28141 leader_election.cc:304] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:14.381620 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c213348428a04c479f871d390b7e3c95" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:14.381894 28667 consensus_queue.cc:260] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.383136 28349 raft_consensus.cc:2468] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:14.392010 28656 ts_tablet_manager.cc:1929] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:14.393935 28478 tablet_service.cc:1511] Processing CreateTablet for tablet d554c2be0f2a436ab5a0a62adcadbdd3 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.395334 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d554c2be0f2a436ab5a0a62adcadbdd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.395421 29083 raft_consensus.cc:515] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.396607 29026 raft_consensus.cc:2804] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:14.398362 29026 raft_consensus.cc:493] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:14.398697 27826 catalog_manager.cc:2213] created HMS catalog entry for table [id=0edebaf949644c84a64c95e5cfae4bf4]
I20260928 07:56:14.398813 29026 raft_consensus.cc:3060] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.397871 28656 log.cc:1199] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/87192a995cc84d5eade9c917de6b2b81
I20260928 07:56:14.403718 28656 ts_tablet_manager.cc:1950] T 87192a995cc84d5eade9c917de6b2b81 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:14.406358 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 87192a995cc84d5eade9c917de6b2b81 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
I20260928 07:56:14.411850 29026 raft_consensus.cc:515] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.417073 27826 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 102) took 2526 ms. Trace:
I20260928 07:56:14.414654 28656 tablet_replica.cc:333] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:14.419837 28656 raft_consensus.cc:2243] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.420338 28656 raft_consensus.cc:2272] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.422176 28656 ts_tablet_manager.cc:1916] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.417536 27826 rpcz_store.cc:276] 0928 07:56:11.890584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.081399 (+190815us) service_pool.cc:224] Handling call
0928 07:56:13.619688 (+1538289us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:13.622903 (+ 3215us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:14.398644 (+775741us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:14.416377 (+ 17733us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:14.416695 (+ 318us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:14.417001 (+ 306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:14.400502 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:14.400897 (+ 395us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:14.400922 (+ 25us) write_op.cc:435] Acquired schema lock
0928 07:56:14.400935 (+ 13us) tablet.cc:662] Decoding operations
0928 07:56:14.401192 (+ 257us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:14.401374 (+ 182us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:14.401399 (+ 25us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:14.401613 (+ 214us) tablet.cc:701] Row locks acquired
0928 07:56:14.401626 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:14.401742 (+ 116us) write_op.cc:270] Start()
0928 07:56:14.401823 (+ 81us) write_op.cc:276] Timestamp: P: 1790582174401680 usec, L: 0
0928 07:56:14.401838 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:14.402361 (+ 523us) log.cc:844] Serialized 433 byte log entry
0928 07:56:14.412700 (+ 10339us) op_driver.cc:464] REPLICATION: finished
0928 07:56:14.413088 (+ 388us) write_op.cc:301] APPLY: starting
0928 07:56:14.413143 (+ 55us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:14.413288 (+ 145us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:14.413408 (+ 120us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:14.413804 (+ 396us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:14.413948 (+ 144us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:14.413990 (+ 42us) write_op.cc:312] APPLY: finished
0928 07:56:14.414175 (+ 185us) log.cc:844] Serialized 29 byte log entry
0928 07:56:14.414316 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:14.414397 (+ 81us) write_op.cc:454] Released schema lock
0928 07:56:14.414428 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:14.414678 (+ 250us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:14.414702 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2545,"Hive Metastore.run_cpu_time_us":719,"Hive Metastore.run_wall_time_us":772477,"child_traces":[["op",{"apply.queue_time_us":250,"apply.run_cpu_time_us":1539,"apply.run_wall_time_us":1553,"num_ops":2,"prepare.queue_time_us":159,"prepare.run_cpu_time_us":2088,"prepare.run_wall_time_us":2189,"raft.queue_time_us":2533,"raft.run_cpu_time_us":648,"raft.run_wall_time_us":648,"replication_time_us":10760}]]}
I20260928 07:56:14.429459 29026 leader_election.cc:290] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:14.435024 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c213348428a04c479f871d390b7e3c95" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:14.435621 28498 raft_consensus.cc:3060] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.447872 29083 leader_election.cc:290] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:14.448048 28496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec0005d4144a2a3b888b7dbcb5087" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:14.408741 28667 ts_tablet_manager.cc:1434] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.143s user 0.005s sys 0.001s
I20260928 07:56:14.419978 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c213348428a04c479f871d390b7e3c95" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:14.448625 28496 raft_consensus.cc:3060] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.448808 28349 raft_consensus.cc:3060] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.449996 28667 tablet_bootstrap.cc:492] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
W20260928 07:56:14.424952 28286 consensus_peers.cc:597] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:14.455446 28496 raft_consensus.cc:2468] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:14.456516 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeec0005d4144a2a3b888b7dbcb5087" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:14.456751 28285 leader_election.cc:304] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:14.457067 28204 raft_consensus.cc:3060] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.445031 28498 raft_consensus.cc:2468] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:14.458398 28141 leader_election.cc:304] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:14.459586 29096 raft_consensus.cc:2804] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:14.460011 29096 raft_consensus.cc:697] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:14.460721 29096 consensus_queue.cc:237] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.463747 28349 raft_consensus.cc:2468] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:14.466537 28204 raft_consensus.cc:2468] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:14.470391 28656 ts_tablet_manager.cc:1929] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:14.475485 28656 log.cc:1199] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/608a4d03b3e341a2898ce42d86288d54
I20260928 07:56:14.476212 28656 ts_tablet_manager.cc:1950] T 608a4d03b3e341a2898ce42d86288d54 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:14.476824 28662 tablet_bootstrap.cc:492] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:14.477377 28662 ts_tablet_manager.cc:1403] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.196s user 0.010s sys 0.000s
I20260928 07:56:14.480569 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 608a4d03b3e341a2898ce42d86288d54 (table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]) successfully deleted
I20260928 07:56:14.475303 27823 catalog_manager.cc:5838] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
W20260928 07:56:14.481500 27815 catalog_manager.cc:5030] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 because the tablet was not found. No further retry: Not found: Tablet not found: 8d8fc8e85fc54877aa0c2afb5f3cbbc5
I20260928 07:56:14.482367 27823 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:14.485177 29083 raft_consensus.cc:2804] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:14.486744 29083 raft_consensus.cc:697] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:14.487849 29083 consensus_queue.cc:237] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.492269 28666 tablet_bootstrap.cc:492] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:14.492739 28666 ts_tablet_manager.cc:1403] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.156s user 0.027s sys 0.025s
I20260928 07:56:14.495299 28666 raft_consensus.cc:359] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.496018 28666 raft_consensus.cc:385] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.496320 28666 raft_consensus.cc:740] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.497201 28666 consensus_queue.cc:260] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.513266 28666 ts_tablet_manager.cc:1434] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260928 07:56:14.513859 29041 ts_tablet_manager.cc:1929] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:14.514253 29041 log.cc:1199] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/3f0480f5920b4ffc8592407417d42d92
I20260928 07:56:14.514982 29041 ts_tablet_manager.cc:1950] T 3f0480f5920b4ffc8592407417d42d92 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:14.517910 29097 raft_consensus.cc:493] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:14.518378 29097 raft_consensus.cc:515] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.519942 27820 catalog_manager.cc:5838] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:14.520879 29097 leader_election.cc:290] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:14.521253 27820 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:14.521931 27820 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:14.523145 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4dae7924a74f0bbdd5bfb4c34be90e" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:14.523504 28662 raft_consensus.cc:359] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.524114 28662 raft_consensus.cc:385] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.524369 28662 raft_consensus.cc:740] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.525527 28662 consensus_queue.cc:260] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.526304 28204 raft_consensus.cc:2468] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:14.528661 28434 leader_election.cc:304] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:14.529417 29097 raft_consensus.cc:2804] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:14.529724 29097 raft_consensus.cc:493] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:14.530009 29097 raft_consensus.cc:3060] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.536839 29097 raft_consensus.cc:515] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.544386 28662 ts_tablet_manager.cc:1434] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.067s user 0.004s sys 0.001s
I20260928 07:56:14.545286 28662 tablet_bootstrap.cc:492] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:14.552449 28655 fs_manager.cc:714] Time spent opening directory manager: real 0.115s user 0.004s sys 0.003s
I20260928 07:56:14.552677 27826 catalog_manager.cc:5838] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:14.558542 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4dae7924a74f0bbdd5bfb4c34be90e" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:14.559146 28204 raft_consensus.cc:3060] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.568874 28204 raft_consensus.cc:2468] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:14.517143 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 128) took 1988 ms. Trace:
I20260928 07:56:14.522722 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4dae7924a74f0bbdd5bfb4c34be90e" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:14.569686 29041 rpcz_store.cc:276] 0928 07:56:12.529133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.529309 (+ 176us) service_pool.cc:224] Handling call
0928 07:56:14.072981 (+1543672us) ts_tablet_manager.cc:1151] Deleting tablet 3f0480f5920b4ffc8592407417d42d92
0928 07:56:14.073110 (+ 129us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:14.344539 (+271429us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:14.513721 (+169182us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:14.517078 (+ 3357us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1542760}
W20260928 07:56:14.570768 28434 leader_election.cc:343] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:14.520334 28667 tablet_bootstrap.cc:654] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.574990 28434 leader_election.cc:304] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:14.577458 29051 raft_consensus.cc:2804] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:14.577401 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4dae7924a74f0bbdd5bfb4c34be90e" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:14.577131 29097 leader_election.cc:290] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
W20260928 07:56:14.578594 28434 leader_election.cc:343] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:14.579662 29041 tablet_replica.cc:333] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:14.580873 29041 raft_consensus.cc:2243] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.583341 28662 tablet_bootstrap.cc:654] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.595268 29041 raft_consensus.cc:2272] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.604416 29121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 07:56:14.615033 28655 fs_manager.cc:730] Time spent opening block manager: real 0.055s user 0.005s sys 0.000s
I20260928 07:56:14.616124 28667 tablet_bootstrap.cc:492] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:14.616714 28667 ts_tablet_manager.cc:1403] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.167s user 0.000s sys 0.010s
I20260928 07:56:14.615684 28655 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data,/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
uuid: "b64b51f6f084474eb360161ac99f9b16"
format_stamp: "Formatted at 2026-09-28 07:55:48 on dist-test-slave-mf55"
I20260928 07:56:14.620352 28667 raft_consensus.cc:359] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.621194 28667 raft_consensus.cc:385] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.621557 28667 raft_consensus.cc:740] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.622552 28667 consensus_queue.cc:260] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.623564 28655 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260928 07:56:14.625877 27820 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet dda49b3ac3104f47bbfc2c780282abca consensus state has no leader
I20260928 07:56:14.626889 28666 tablet_bootstrap.cc:492] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:14.600191 29041 ts_tablet_manager.cc:1916] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.635402 28658 ts_tablet_manager.cc:1929] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:14.639554 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:14.640187 28658 log.cc:1199] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/608a4d03b3e341a2898ce42d86288d54
I20260928 07:56:14.645504 29051 raft_consensus.cc:697] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:14.652763 28667 ts_tablet_manager.cc:1434] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.036s user 0.003s sys 0.006s
I20260928 07:56:14.653748 28667 tablet_bootstrap.cc:492] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:14.669063 29051 consensus_queue.cc:237] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.675761 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac50af1b39345b8a75ba38ba06de5a1 (DEFAULT_TABLE table=default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.676918 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac50af1b39345b8a75ba38ba06de5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.679250 28662 tablet_bootstrap.cc:492] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:14.684904 28666 tablet_bootstrap.cc:654] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.686435 28667 tablet_bootstrap.cc:654] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.687798 28658 ts_tablet_manager.cc:1950] T 608a4d03b3e341a2898ce42d86288d54 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:14.690550 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 608a4d03b3e341a2898ce42d86288d54 (table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]) successfully deleted
I20260928 07:56:14.679708 28662 ts_tablet_manager.cc:1403] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.135s user 0.034s sys 0.036s
I20260928 07:56:14.693503 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 93bcaa047c2b46f69b6c686e95053c1c from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:14.693979 28662 raft_consensus.cc:359] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.694599 28662 raft_consensus.cc:385] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.694851 28662 raft_consensus.cc:740] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.698091 27822 catalog_manager.cc:2213] created HMS catalog entry for table [id=388cd42a4adf4001ba834ceb219df8b7]
I20260928 07:56:14.719456 27822 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 103) took 2640 ms. Trace:
I20260928 07:56:14.719791 27822 rpcz_store.cc:276] 0928 07:56:12.078720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.168743 (+ 90023us) service_pool.cc:224] Handling call
0928 07:56:13.655531 (+1486788us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:13.657701 (+ 2170us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:14.698047 (+1040346us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:14.718812 (+ 20765us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:14.719097 (+ 285us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:14.719392 (+ 295us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:14.704623 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:14.705139 (+ 516us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:14.705163 (+ 24us) write_op.cc:435] Acquired schema lock
0928 07:56:14.705176 (+ 13us) tablet.cc:662] Decoding operations
0928 07:56:14.705481 (+ 305us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:14.705523 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:14.705545 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:14.705739 (+ 194us) tablet.cc:701] Row locks acquired
0928 07:56:14.705752 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:14.705876 (+ 124us) write_op.cc:270] Start()
0928 07:56:14.705963 (+ 87us) write_op.cc:276] Timestamp: P: 1790582174705782 usec, L: 0
0928 07:56:14.705978 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:14.706457 (+ 479us) log.cc:844] Serialized 433 byte log entry
0928 07:56:14.716746 (+ 10289us) op_driver.cc:464] REPLICATION: finished
0928 07:56:14.717107 (+ 361us) write_op.cc:301] APPLY: starting
0928 07:56:14.717166 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:14.717305 (+ 139us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:14.717409 (+ 104us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:14.717822 (+ 413us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:14.717980 (+ 158us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:14.718021 (+ 41us) write_op.cc:312] APPLY: finished
0928 07:56:14.718199 (+ 178us) log.cc:844] Serialized 29 byte log entry
0928 07:56:14.718356 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:14.718427 (+ 71us) write_op.cc:454] Released schema lock
0928 07:56:14.718457 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":740444,"Hive Metastore.run_cpu_time_us":622,"Hive Metastore.run_wall_time_us":299004,"child_traces":[["op",{"apply.queue_time_us":220,"apply.run_cpu_time_us":1536,"apply.run_wall_time_us":1535,"num_ops":2,"prepare.queue_time_us":5005,"raft.queue_time_us":83,"raft.run_cpu_time_us":603,"raft.run_wall_time_us":603,"replication_time_us":10674}]]}
I20260928 07:56:14.726888 28662 consensus_queue.cc:260] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.734406 28662 ts_tablet_manager.cc:1434] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.043s user 0.005s sys 0.000s
I20260928 07:56:14.735314 28662 tablet_bootstrap.cc:492] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:14.739415 29083 consensus_queue.cc:1048] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:14.747258 27822 catalog_manager.cc:5838] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:14.752609 29041 ts_tablet_manager.cc:1929] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:14.753013 29041 log.cc:1199] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/d9220066aaeb4417a73707bd5679846f
I20260928 07:56:14.759313 28667 tablet_bootstrap.cc:492] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:14.759763 28667 ts_tablet_manager.cc:1403] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.006s
I20260928 07:56:14.762557 28667 raft_consensus.cc:359] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.763170 28667 raft_consensus.cc:385] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.763592 28662 tablet_bootstrap.cc:654] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.763823 28667 raft_consensus.cc:740] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.772373 29084 consensus_queue.cc:1048] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:14.778033 29041 ts_tablet_manager.cc:1950] T d9220066aaeb4417a73707bd5679846f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:14.784382 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 129) took 2087 ms. Trace:
I20260928 07:56:14.793457 29041 rpcz_store.cc:276] 0928 07:56:12.696883 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.697008 (+ 125us) service_pool.cc:224] Handling call
0928 07:56:14.578766 (+1881758us) ts_tablet_manager.cc:1151] Deleting tablet d9220066aaeb4417a73707bd5679846f
0928 07:56:14.578833 (+ 67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:14.703258 (+124425us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:14.752457 (+ 49199us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:14.784290 (+ 31833us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1881223}
I20260928 07:56:14.795770 29041 tablet_replica.cc:333] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:14.796012 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet d9220066aaeb4417a73707bd5679846f (table default.table_66df2d021af141bf9af764fb609f0941 [id=88fa2ddd307e49ab85b4eaa911b6669b]) successfully deleted
I20260928 07:56:14.803319 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac50af1b39345b8a75ba38ba06de5a1 (DEFAULT_TABLE table=default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.804438 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac50af1b39345b8a75ba38ba06de5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.804783 29041 raft_consensus.cc:2243] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.805470 29041 raft_consensus.cc:2272] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.808131 29041 ts_tablet_manager.cc:1916] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.808903 28666 tablet_bootstrap.cc:492] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:14.809496 28666 ts_tablet_manager.cc:1403] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.183s user 0.010s sys 0.000s
I20260928 07:56:14.812193 28666 raft_consensus.cc:359] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.812783 28666 raft_consensus.cc:385] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.813091 28662 tablet_bootstrap.cc:492] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:14.813649 28662 ts_tablet_manager.cc:1403] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.007s
I20260928 07:56:14.816167 28662 raft_consensus.cc:359] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.772686 27826 catalog_manager.cc:5838] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:14.818322 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec9ebafa7c248ceb280587e49d964b7 (DEFAULT_TABLE table=default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.824456 28662 raft_consensus.cc:385] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.824733 28662 raft_consensus.cc:740] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.825068 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec9ebafa7c248ceb280587e49d964b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.833084 28662 consensus_queue.cc:260] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.816174 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac50af1b39345b8a75ba38ba06de5a1 (DEFAULT_TABLE table=default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.837066 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac50af1b39345b8a75ba38ba06de5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.819923 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec9ebafa7c248ceb280587e49d964b7 (DEFAULT_TABLE table=default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.839910 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec9ebafa7c248ceb280587e49d964b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.835109 28662 ts_tablet_manager.cc:1434] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.021s user 0.004s sys 0.000s
I20260928 07:56:14.849166 29119 raft_consensus.cc:493] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:14.849917 29119 raft_consensus.cc:515] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.851938 29119 leader_election.cc:290] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:14.853513 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda49b3ac3104f47bbfc2c780282abca" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:14.854655 27823 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 93bcaa047c2b46f69b6c686e95053c1c
W20260928 07:56:14.854967 28434 leader_election.cc:343] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:14.856184 27823 catalog_manager.cc:6934] ReplaceTablet: tablet 93bcaa047c2b46f69b6c686e95053c1c deleted and replaced by tablet be116490ca57460688eaa2ff1c0415de
I20260928 07:56:14.856503 28327 tablet_service.cc:1558] Processing DeleteTablet for tablet 93bcaa047c2b46f69b6c686e95053c1c with delete_type TABLET_DATA_DELETED (replaced by tablet be116490ca57460688eaa2ff1c0415de) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:14.856843 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 93bcaa047c2b46f69b6c686e95053c1c with delete_type TABLET_DATA_DELETED (replaced by tablet be116490ca57460688eaa2ff1c0415de) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:14.857107 27823 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_569bbac4a1954d0bb6993bcd887049cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:14.857791 28658 tablet_replica.cc:333] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:14.858548 28658 raft_consensus.cc:2243] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:14.859068 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 93bcaa047c2b46f69b6c686e95053c1c with delete_type TABLET_DATA_DELETED (replaced by tablet be116490ca57460688eaa2ff1c0415de) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:14.859406 28658 raft_consensus.cc:2272] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.859760 28656 tablet_replica.cc:333] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:14.859947 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda49b3ac3104f47bbfc2c780282abca" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:14.860505 28656 raft_consensus.cc:2243] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:14.861001 28656 raft_consensus.cc:2272] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:14.860519 28205 raft_consensus.cc:2468] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:14.862628 28658 ts_tablet_manager.cc:1916] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.862915 28656 ts_tablet_manager.cc:1916] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:14.863176 28434 leader_election.cc:304] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:14.868295 29051 raft_consensus.cc:2804] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:14.868675 29051 raft_consensus.cc:493] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:14.869024 29051 raft_consensus.cc:3060] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.885447 28349 raft_consensus.cc:1275] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Refusing update from remote peer bae11841a62f429a98a978de5b7bd60e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:14.886731 29028 raft_consensus.cc:493] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:14.887216 29028 raft_consensus.cc:515] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.890183 29028 leader_election.cc:290] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:14.891472 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657aa60685c740adbecdc1579270066e" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:14.895155 29097 consensus_queue.cc:1048] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:14.899480 27820 catalog_manager.cc:5838] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:14.903944 28205 raft_consensus.cc:1275] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Refusing update from remote peer bae11841a62f429a98a978de5b7bd60e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:14.767820 28667 consensus_queue.cc:260] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.909883 29119 consensus_queue.cc:1048] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 07:56:14.916602 28285 consensus_peers.cc:597] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 -> Peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Couldn't send request to peer bae11841a62f429a98a978de5b7bd60e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 608a4d03b3e341a2898ce42d86288d54. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:14.926702 28658 ts_tablet_manager.cc:1929] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:14.929762 28667 ts_tablet_manager.cc:1434] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.170s user 0.008s sys 0.001s
I20260928 07:56:14.928853 27820 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_a5ebdbbec89645fe963b774cb3b57dae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:14.944831 28662 tablet_bootstrap.cc:492] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:14.911768 28496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657aa60685c740adbecdc1579270066e" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:14.935921 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec9ebafa7c248ceb280587e49d964b7 (DEFAULT_TABLE table=default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:14.945936 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec9ebafa7c248ceb280587e49d964b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:14.954470 28662 tablet_bootstrap.cc:654] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:14.957319 28496 raft_consensus.cc:2393] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bd67de620c94af3b7c8e3ba7d42f980 in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:14.813050 28666 raft_consensus.cc:740] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.963804 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet f942bd0b3bbc4d908633722e32bf11b8 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:14.964725 28656 ts_tablet_manager.cc:1929] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:14.964709 28658 log.cc:1199] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/93bcaa047c2b46f69b6c686e95053c1c
I20260928 07:56:14.966209 28658 ts_tablet_manager.cc:1950] T 93bcaa047c2b46f69b6c686e95053c1c P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:14.969327 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 93bcaa047c2b46f69b6c686e95053c1c (table default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]) successfully deleted
I20260928 07:56:14.970415 28666 consensus_queue.cc:260] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:14.972656 28666 ts_tablet_manager.cc:1434] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.163s user 0.006s sys 0.000s
I20260928 07:56:14.959098 28285 leader_election.cc:304] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:14.975059 28351 raft_consensus.cc:3060] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:14.980028 28667 tablet_bootstrap.cc:492] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:14.987841 28656 log.cc:1199] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/93bcaa047c2b46f69b6c686e95053c1c
I20260928 07:56:14.988740 28656 ts_tablet_manager.cc:1950] T 93bcaa047c2b46f69b6c686e95053c1c P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:14.987349 28662 tablet_bootstrap.cc:492] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:14.991427 28662 ts_tablet_manager.cc:1403] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.000s
I20260928 07:56:14.991961 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 93bcaa047c2b46f69b6c686e95053c1c (table default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]) successfully deleted
I20260928 07:56:14.993933 28662 raft_consensus.cc:359] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:14.994560 28662 raft_consensus.cc:385] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:14.994794 28662 raft_consensus.cc:740] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:14.995493 28662 consensus_queue.cc:260] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.001995 29051 raft_consensus.cc:515] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.025908 28662 ts_tablet_manager.cc:1434] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.034s user 0.001s sys 0.004s
I20260928 07:56:15.026975 29041 ts_tablet_manager.cc:1929] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:15.027431 29041 log.cc:1199] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/af8c024a510c442caa981892d0469221
I20260928 07:56:15.028738 29041 ts_tablet_manager.cc:1950] T af8c024a510c442caa981892d0469221 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:15.031013 29026 raft_consensus.cc:493] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:15.031477 29026 raft_consensus.cc:515] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.034037 29026 leader_election.cc:290] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
W20260928 07:56:15.037585 28142 leader_election.cc:343] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 1ac50af1b39345b8a75ba38ba06de5a1
I20260928 07:56:15.058126 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet f942bd0b3bbc4d908633722e32bf11b8
I20260928 07:56:15.059862 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet f942bd0b3bbc4d908633722e32bf11b8 with delete_type TABLET_DATA_DELETED (replaced by tablet f9854b3eee6746188e47fe1b656130dd) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:15.060696 28656 tablet_replica.cc:333] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:15.061482 28656 raft_consensus.cc:2243] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:15.061975 28656 raft_consensus.cc:2272] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:15.065047 28656 ts_tablet_manager.cc:1916] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:15.070766 28327 tablet_service.cc:1558] Processing DeleteTablet for tablet f942bd0b3bbc4d908633722e32bf11b8 with delete_type TABLET_DATA_DELETED (replaced by tablet f9854b3eee6746188e47fe1b656130dd) from {username='slave'} at 127.0.0.1:60428
W20260928 07:56:15.071516 27816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.252:41205, user_credentials={real_user=slave}} blocked reactor thread for 53687.5us
I20260928 07:56:15.072044 29026 consensus_queue.cc:1048] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:15.073256 27822 catalog_manager.cc:6934] ReplaceTablet: tablet f942bd0b3bbc4d908633722e32bf11b8 deleted and replaced by tablet f9854b3eee6746188e47fe1b656130dd
I20260928 07:56:15.080796 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 133) took 2141 ms. Trace:
I20260928 07:56:15.084851 28662 tablet_bootstrap.cc:492] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:15.081625 29028 raft_consensus.cc:2749] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:15.090574 28662 tablet_bootstrap.cc:654] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.108187 27826 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:15.117776 28662 tablet_bootstrap.cc:492] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:15.118206 28662 ts_tablet_manager.cc:1403] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.000s
I20260928 07:56:15.120759 28662 raft_consensus.cc:359] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.121416 28662 raft_consensus.cc:385] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.121682 28662 raft_consensus.cc:740] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.121907 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:15.122284 28662 consensus_queue.cc:260] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.122989 28187 tablet_service.cc:1511] Processing CreateTablet for tablet be116490ca57460688eaa2ff1c0415de (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.124024 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be116490ca57460688eaa2ff1c0415de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.126200 28327 tablet_service.cc:1511] Processing CreateTablet for tablet be116490ca57460688eaa2ff1c0415de (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.127296 28327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be116490ca57460688eaa2ff1c0415de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.008078 28666 tablet_bootstrap.cc:492] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:15.108511 29041 rpcz_store.cc:276] 0928 07:56:12.938922 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.939089 (+ 167us) service_pool.cc:224] Handling call
0928 07:56:14.795583 (+1856494us) ts_tablet_manager.cc:1151] Deleting tablet af8c024a510c442caa981892d0469221
0928 07:56:14.795646 (+ 63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:14.911528 (+115882us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:15.026832 (+115304us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:15.080675 (+ 53843us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1855622}
I20260928 07:56:15.131464 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet af8c024a510c442caa981892d0469221 (table default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
I20260928 07:56:15.034298 28496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac50af1b39345b8a75ba38ba06de5a1" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:15.133374 29041 tablet_replica.cc:333] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:15.035219 29140 tablet.cc:1751] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:15.134181 29041 raft_consensus.cc:2243] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:15.134919 29041 pending_rounds.cc:70] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 1 pending ops.
I20260928 07:56:15.135140 29041 pending_rounds.cc:77] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224585804365824 op_type: NO_OP noop_request { }
I20260928 07:56:15.135524 29041 raft_consensus.cc:2889] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:15.135893 29041 raft_consensus.cc:2272] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:15.140650 28286 consensus_peers.cc:597] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d8fc8e85fc54877aa0c2afb5f3cbbc5. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:15.072875 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet f942bd0b3bbc4d908633722e32bf11b8 with delete_type TABLET_DATA_DELETED (replaced by tablet f9854b3eee6746188e47fe1b656130dd) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:15.112776 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 8e64d9a4cd23460a8b311ced5acf4170 (DEFAULT_TABLE table=default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.143380 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 8e64d9a4cd23460a8b311ced5acf4170 (DEFAULT_TABLE table=default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.144433 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e64d9a4cd23460a8b311ced5acf4170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.145776 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 8e64d9a4cd23460a8b311ced5acf4170 (DEFAULT_TABLE table=default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.148850 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda49b3ac3104f47bbfc2c780282abca" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:15.119019 28479 tablet_service.cc:1511] Processing CreateTablet for tablet be116490ca57460688eaa2ff1c0415de (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 07:56:15.150157 28434 leader_election.cc:343] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:15.151351 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda49b3ac3104f47bbfc2c780282abca" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:15.151949 28205 raft_consensus.cc:3060] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.150197 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be116490ca57460688eaa2ff1c0415de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:15.157536 28141 leader_election.cc:343] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:15.157979 28141 leader_election.cc:304] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:15.161739 28658 tablet_replica.cc:333] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:15.162460 28658 raft_consensus.cc:2243] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:15.162945 28658 raft_consensus.cc:2272] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:15.164216 29041 ts_tablet_manager.cc:1916] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:15.166821 28658 ts_tablet_manager.cc:1916] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:15.179489 28666 tablet_bootstrap.cc:654] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.183977 29026 raft_consensus.cc:2749] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:15.191581 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e64d9a4cd23460a8b311ced5acf4170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.193042 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e64d9a4cd23460a8b311ced5acf4170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.208866 27826 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:15.181165 29144 tablet.cc:1751] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:15.051440 28667 tablet_bootstrap.cc:654] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.214381 28662 ts_tablet_manager.cc:1434] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.096s user 0.016s sys 0.005s
I20260928 07:56:15.220136 28656 ts_tablet_manager.cc:1929] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:15.223609 28662 tablet_bootstrap.cc:492] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:15.235739 28662 tablet_bootstrap.cc:654] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.243377 28666 tablet_bootstrap.cc:492] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:15.246006 29028 raft_consensus.cc:493] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:15.246474 29028 raft_consensus.cc:515] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.248497 29028 leader_election.cc:290] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:15.184667 29051 leader_election.cc:290] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
W20260928 07:56:15.254817 28434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 83434.6us
I20260928 07:56:15.263170 28666 ts_tablet_manager.cc:1403] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.255s user 0.010s sys 0.001s
I20260928 07:56:15.264936 28496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4dae7924a74f0bbdd5bfb4c34be90e" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:15.266234 28666 raft_consensus.cc:359] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.266912 28666 raft_consensus.cc:385] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.267189 28666 raft_consensus.cc:740] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.267858 28666 consensus_queue.cc:260] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:15.278695 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet dda49b3ac3104f47bbfc2c780282abca consensus state has no leader
I20260928 07:56:15.297052 28666 ts_tablet_manager.cc:1434] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260928 07:56:15.300002 28658 ts_tablet_manager.cc:1929] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:15.245014 28205 raft_consensus.cc:2468] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:15.305645 29119 raft_consensus.cc:493] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:15.315996 29149 consensus_queue.cc:1048] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:15.325472 29119 raft_consensus.cc:515] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.330883 28434 leader_election.cc:304] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:15.262718 28662 tablet_bootstrap.cc:492] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:15.331676 28662 ts_tablet_manager.cc:1403] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.108s user 0.015s sys 0.004s
I20260928 07:56:15.334105 29097 raft_consensus.cc:2804] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:15.334610 29097 raft_consensus.cc:697] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:15.334365 28662 raft_consensus.cc:359] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.335048 28662 raft_consensus.cc:385] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.335322 28662 raft_consensus.cc:740] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.336067 28662 consensus_queue.cc:260] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.335712 29097 consensus_queue.cc:237] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.337188 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:15.342792 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet a97ca287aa0e4ffcb387cc1c144a5a31 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:15.252588 28656 log.cc:1199] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/f942bd0b3bbc4d908633722e32bf11b8
I20260928 07:56:15.348807 28656 ts_tablet_manager.cc:1950] T f942bd0b3bbc4d908633722e32bf11b8 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:15.348743 29119 leader_election.cc:290] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
W20260928 07:56:15.348979 28285 consensus_peers.cc:597] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 -> Peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Couldn't send request to peer bae11841a62f429a98a978de5b7bd60e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d8fc8e85fc54877aa0c2afb5f3cbbc5. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:15.276626 29147 raft_consensus.cc:493] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:15.350100 29147 raft_consensus.cc:515] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.350829 28187 tablet_service.cc:1511] Processing CreateTablet for tablet f9854b3eee6746188e47fe1b656130dd (DEFAULT_TABLE table=default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.351888 28662 ts_tablet_manager.cc:1434] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260928 07:56:15.351975 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9854b3eee6746188e47fe1b656130dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.353781 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec9ebafa7c248ceb280587e49d964b7" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:15.357578 28142 leader_election.cc:343] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:15.360941 29149 raft_consensus.cc:493] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:15.361465 29149 raft_consensus.cc:515] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.363955 29149 leader_election.cc:290] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:15.366555 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d554c2be0f2a436ab5a0a62adcadbdd3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:15.368199 28142 leader_election.cc:343] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:15.369818 28331 tablet_service.cc:1511] Processing CreateTablet for tablet f9854b3eee6746188e47fe1b656130dd (DEFAULT_TABLE table=default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.370913 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9854b3eee6746188e47fe1b656130dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.377810 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet f942bd0b3bbc4d908633722e32bf11b8 (table default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]) successfully deleted
I20260928 07:56:15.382001 28479 tablet_service.cc:1511] Processing CreateTablet for tablet f9854b3eee6746188e47fe1b656130dd (DEFAULT_TABLE table=default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.383363 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9854b3eee6746188e47fe1b656130dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.388042 29028 consensus_queue.cc:1048] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:15.250880 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4dae7924a74f0bbdd5bfb4c34be90e" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:15.392616 28204 raft_consensus.cc:2393] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bd67de620c94af3b7c8e3ba7d42f980 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:15.395258 28286 leader_election.cc:304] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:15.396420 29028 raft_consensus.cc:3060] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.401813 29147 leader_election.cc:290] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:15.403983 29028 raft_consensus.cc:2749] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:15.323844 28666 tablet_bootstrap.cc:492] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:15.419585 28658 log.cc:1199] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/f942bd0b3bbc4d908633722e32bf11b8
I20260928 07:56:15.420516 28658 ts_tablet_manager.cc:1950] T f942bd0b3bbc4d908633722e32bf11b8 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:15.426342 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac50af1b39345b8a75ba38ba06de5a1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:15.440922 28662 tablet_bootstrap.cc:492] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:15.445272 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet a97ca287aa0e4ffcb387cc1c144a5a31
I20260928 07:56:15.447393 28662 tablet_bootstrap.cc:654] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.448333 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec9ebafa7c248ceb280587e49d964b7" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:15.452785 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet f942bd0b3bbc4d908633722e32bf11b8 (table default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]) successfully deleted
I20260928 07:56:15.455487 28667 tablet_bootstrap.cc:492] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:15.455961 28667 ts_tablet_manager.cc:1403] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.476s user 0.007s sys 0.024s
I20260928 07:56:15.456396 29158 tablet.cc:1751] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 07:56:15.457577 28434 leader_election.cc:343] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:15.458729 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet a97ca287aa0e4ffcb387cc1c144a5a31 with delete_type TABLET_DATA_DELETED (replaced by tablet d9cf8015fec54fb7874e93717fc8d38b) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:15.458638 28667 raft_consensus.cc:359] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.459335 28667 raft_consensus.cc:385] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.459607 28667 raft_consensus.cc:740] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.461457 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet a97ca287aa0e4ffcb387cc1c144a5a31 with delete_type TABLET_DATA_DELETED (replaced by tablet d9cf8015fec54fb7874e93717fc8d38b) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:15.462332 28658 tablet_replica.cc:333] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:15.462384 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet a97ca287aa0e4ffcb387cc1c144a5a31 with delete_type TABLET_DATA_DELETED (replaced by tablet d9cf8015fec54fb7874e93717fc8d38b) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:15.463178 28658 raft_consensus.cc:2243] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:15.463387 28666 tablet_bootstrap.cc:654] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:15.463992 28141 leader_election.cc:343] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:15.464421 28141 leader_election.cc:304] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:15.465206 29148 raft_consensus.cc:2749] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:15.466001 28656 tablet_replica.cc:333] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:15.466647 28496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d554c2be0f2a436ab5a0a62adcadbdd3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:15.467391 28496 raft_consensus.cc:2468] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:15.471123 28656 raft_consensus.cc:2243] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:15.471613 28656 raft_consensus.cc:2272] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:15.473345 28656 ts_tablet_manager.cc:1916] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:15.478717 28662 tablet_bootstrap.cc:492] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:15.479161 28662 ts_tablet_manager.cc:1403] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.000s
I20260928 07:56:15.482816 28662 raft_consensus.cc:359] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.483429 28662 raft_consensus.cc:385] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.483677 28662 raft_consensus.cc:740] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.483683 27822 catalog_manager.cc:6934] ReplaceTablet: tablet a97ca287aa0e4ffcb387cc1c144a5a31 deleted and replaced by tablet d9cf8015fec54fb7874e93717fc8d38b
I20260928 07:56:15.484285 28662 consensus_queue.cc:260] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.490031 28662 ts_tablet_manager.cc:1434] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260928 07:56:15.484761 28667 consensus_queue.cc:260] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.492689 28667 ts_tablet_manager.cc:1434] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.036s user 0.007s sys 0.001s
I20260928 07:56:15.495596 28667 tablet_bootstrap.cc:492] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:15.475342 28658 raft_consensus.cc:2272] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:15.497591 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac50af1b39345b8a75ba38ba06de5a1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:15.498456 28205 raft_consensus.cc:2468] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:15.500949 28658 ts_tablet_manager.cc:1916] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:15.505929 29148 consensus_queue.cc:1048] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:15.516482 28667 tablet_bootstrap.cc:654] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.528230 28666 tablet_bootstrap.cc:492] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:15.528687 28666 ts_tablet_manager.cc:1403] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.205s user 0.014s sys 0.001s
I20260928 07:56:15.530951 28667 tablet_bootstrap.cc:492] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:15.531349 28667 ts_tablet_manager.cc:1403] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.005s
I20260928 07:56:15.534313 28667 raft_consensus.cc:359] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.537021 27821 catalog_manager.cc:3541] renamed table default.table_0c6b380af93d44238ab04f5fce282fbf [id=069e22d7ef5d43e1b5e323608df44264] in HMS: new name default.table_dc4f70aae79849ffaa203b8cc751126e
I20260928 07:56:15.535946 28667 raft_consensus.cc:385] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.538339 28667 raft_consensus.cc:740] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.539062 28667 consensus_queue.cc:260] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.531131 28666 raft_consensus.cc:359] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.545750 28666 raft_consensus.cc:385] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.546056 28666 raft_consensus.cc:740] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.546661 28666 consensus_queue.cc:260] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.547531 28667 ts_tablet_manager.cc:1434] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260928 07:56:15.551772 28666 ts_tablet_manager.cc:1434] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20260928 07:56:15.552109 28667 tablet_bootstrap.cc:492] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:15.552637 28666 tablet_bootstrap.cc:492] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:15.556110 28662 tablet_bootstrap.cc:492] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:15.566911 29041 ts_tablet_manager.cc:1929] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:15.568842 29041 log.cc:1199] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/bb0392cdda8141579c2875548e59f29f
I20260928 07:56:15.571431 28662 tablet_bootstrap.cc:654] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.573297 29041 ts_tablet_manager.cc:1950] T bb0392cdda8141579c2875548e59f29f P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:15.581393 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 139) took 1937 ms. Trace:
I20260928 07:56:15.583839 28666 tablet_bootstrap.cc:654] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.595149 29041 rpcz_store.cc:276] 0928 07:56:13.644357 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:13.687387 (+ 43030us) service_pool.cc:224] Handling call
0928 07:56:15.133170 (+1445783us) ts_tablet_manager.cc:1151] Deleting tablet bb0392cdda8141579c2875548e59f29f
0928 07:56:15.133241 (+ 71us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:15.479875 (+346634us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:15.566789 (+ 86914us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:15.581329 (+ 14540us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1444648}
I20260928 07:56:15.600167 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet bb0392cdda8141579c2875548e59f29f (table default.table_1bf0b919ff68446aae3e010b1984050d [id=659e362fe6584f90b283788d579b9321]) successfully deleted
I20260928 07:56:15.601329 29041 tablet_replica.cc:333] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:15.604388 29041 raft_consensus.cc:2243] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:15.605357 29041 pending_rounds.cc:70] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 1 pending ops.
I20260928 07:56:15.608014 29041 pending_rounds.cc:77] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224584943300608 op_type: NO_OP noop_request { }
I20260928 07:56:15.608444 28662 tablet_bootstrap.cc:492] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:15.608932 28662 ts_tablet_manager.cc:1403] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.053s user 0.013s sys 0.003s
I20260928 07:56:15.611913 29041 raft_consensus.cc:2889] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:15.611596 28662 raft_consensus.cc:359] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.612247 28662 raft_consensus.cc:385] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.612514 28662 raft_consensus.cc:740] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.612350 28184 tablet_service.cc:1511] Processing CreateTablet for tablet d9cf8015fec54fb7874e93717fc8d38b (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.612412 29041 raft_consensus.cc:2272] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:15.606582 28667 tablet_bootstrap.cc:654] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.613406 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cf8015fec54fb7874e93717fc8d38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.614719 29028 raft_consensus.cc:493] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bae11841a62f429a98a978de5b7bd60e)
I20260928 07:56:15.615193 29028 raft_consensus.cc:515] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.615891 29041 ts_tablet_manager.cc:1916] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:15.617244 29028 leader_election.cc:290] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:15.619058 28662 consensus_queue.cc:260] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:15.619971 28286 leader_election.cc:343] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 7fa47d4f3bbb45f89a1750e512614b98
I20260928 07:56:15.621081 28662 ts_tablet_manager.cc:1434] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260928 07:56:15.637327 28667 tablet_bootstrap.cc:492] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:15.637809 28667 ts_tablet_manager.cc:1403] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.090s user 0.013s sys 0.001s
I20260928 07:56:15.640626 28667 raft_consensus.cc:359] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.645469 28667 raft_consensus.cc:385] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.645774 28667 raft_consensus.cc:740] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.646548 28667 consensus_queue.cc:260] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.648695 28141 leader_election.cc:304] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:15.649833 29147 raft_consensus.cc:2804] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:15.649492 28478 tablet_service.cc:1511] Processing CreateTablet for tablet d9cf8015fec54fb7874e93717fc8d38b (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.650154 29147 raft_consensus.cc:493] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:15.650458 29147 raft_consensus.cc:3060] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.651469 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cf8015fec54fb7874e93717fc8d38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.660290 28667 ts_tablet_manager.cc:1434] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20260928 07:56:15.660081 28331 tablet_service.cc:1511] Processing CreateTablet for tablet d9cf8015fec54fb7874e93717fc8d38b (DEFAULT_TABLE table=default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.661106 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cf8015fec54fb7874e93717fc8d38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.667279 29148 consensus_queue.cc:1048] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:15.647197 28434 leader_election.cc:304] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:15.678331 28666 tablet_bootstrap.cc:492] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:15.679001 28666 ts_tablet_manager.cc:1403] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.127s user 0.009s sys 0.000s
I20260928 07:56:15.683772 29097 raft_consensus.cc:2804] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:15.684283 29097 raft_consensus.cc:493] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:15.684432 28667 tablet_bootstrap.cc:492] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:15.684594 29097 raft_consensus.cc:3060] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.678510 29147 raft_consensus.cc:515] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.690529 28662 tablet_bootstrap.cc:492] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:15.692410 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d554c2be0f2a436ab5a0a62adcadbdd3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:15.692975 28351 raft_consensus.cc:3060] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.696367 28662 tablet_bootstrap.cc:654] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.699700 28351 raft_consensus.cc:2468] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:15.700893 28142 leader_election.cc:304] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
W20260928 07:56:15.701311 28434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 54508.7us
I20260928 07:56:15.704573 29028 consensus_queue.cc:1048] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:15.705547 29148 raft_consensus.cc:2804] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:15.706033 29148 raft_consensus.cc:697] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:15.706913 29148 consensus_queue.cc:237] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.718281 29147 leader_election.cc:290] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:15.713704 28666 raft_consensus.cc:359] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.719542 28666 raft_consensus.cc:385] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.719877 28666 raft_consensus.cc:740] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.720592 28666 consensus_queue.cc:260] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:15.729875 28285 leader_election.cc:343] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Not found: Tablet not found: 7fa47d4f3bbb45f89a1750e512614b98
I20260928 07:56:15.730280 28285 leader_election.cc:304] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:15.731223 29028 raft_consensus.cc:2749] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 07:56:15.727612 28658 ts_tablet_manager.cc:1929] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:15.736042 28658 log.cc:1199] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/a97ca287aa0e4ffcb387cc1c144a5a31
I20260928 07:56:15.738572 28662 tablet_bootstrap.cc:492] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:15.739006 28662 ts_tablet_manager.cc:1403] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.004s
I20260928 07:56:15.734021 28656 ts_tablet_manager.cc:1929] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:15.750583 28656 log.cc:1199] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/a97ca287aa0e4ffcb387cc1c144a5a31
I20260928 07:56:15.751371 28656 ts_tablet_manager.cc:1950] T a97ca287aa0e4ffcb387cc1c144a5a31 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:15.756085 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet a97ca287aa0e4ffcb387cc1c144a5a31 (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]) successfully deleted
I20260928 07:56:15.736439 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d554c2be0f2a436ab5a0a62adcadbdd3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:15.757050 28498 raft_consensus.cc:3060] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.758757 28662 raft_consensus.cc:359] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.759521 28662 raft_consensus.cc:385] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.759764 28662 raft_consensus.cc:740] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.760392 28662 consensus_queue.cc:260] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.757710 28667 tablet_bootstrap.cc:654] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.764950 28498 raft_consensus.cc:2468] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:15.740882 28666 ts_tablet_manager.cc:1434] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.062s user 0.005s sys 0.003s
I20260928 07:56:15.746205 29119 consensus_queue.cc:1048] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:15.767284 28666 tablet_bootstrap.cc:492] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:15.775620 28658 ts_tablet_manager.cc:1950] T a97ca287aa0e4ffcb387cc1c144a5a31 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:15.779247 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet a97ca287aa0e4ffcb387cc1c144a5a31 (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]) successfully deleted
I20260928 07:56:15.780927 29097 raft_consensus.cc:515] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.783217 29097 leader_election.cc:290] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:15.790427 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac50af1b39345b8a75ba38ba06de5a1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:15.790967 28207 raft_consensus.cc:3060] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.797049 28207 raft_consensus.cc:2468] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:15.799036 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac50af1b39345b8a75ba38ba06de5a1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
W20260928 07:56:15.800488 28434 leader_election.cc:343] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:15.801139 28434 leader_election.cc:304] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:15.687295 27822 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:15.814071 29097 raft_consensus.cc:2804] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:15.814321 28662 ts_tablet_manager.cc:1434] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.075s user 0.006s sys 0.000s
W20260928 07:56:15.822355 28655 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 0.863s user 0.002s sys 0.004s
W20260928 07:56:15.822741 28655 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 0.864s user 0.003s sys 0.004s
I20260928 07:56:15.823072 28666 tablet_bootstrap.cc:654] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.835732 27824 catalog_manager.cc:2213] created HMS catalog entry for table [id=37cb2283a0b64189b50487bda9b788a9]
I20260928 07:56:15.841019 28667 tablet_bootstrap.cc:492] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:15.841583 28667 ts_tablet_manager.cc:1403] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.157s user 0.011s sys 0.000s
I20260928 07:56:15.817127 29041 ts_tablet_manager.cc:1929] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:15.849148 27826 catalog_manager.cc:6391] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2] alter complete (version 1)
I20260928 07:56:15.856485 29041 log.cc:1199] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/8d8fc8e85fc54877aa0c2afb5f3cbbc5
I20260928 07:56:15.858237 29041 ts_tablet_manager.cc:1950] T 8d8fc8e85fc54877aa0c2afb5f3cbbc5 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:15.858503 27824 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 110) took 2887 ms. Trace:
I20260928 07:56:15.863408 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 135) took 2275 ms. Trace:
I20260928 07:56:15.863760 29041 rpcz_store.cc:276] 0928 07:56:13.588743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:13.744703 (+155960us) service_pool.cc:224] Handling call
0928 07:56:15.601123 (+1856420us) ts_tablet_manager.cc:1151] Deleting tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5
0928 07:56:15.601184 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:15.735675 (+134491us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:15.816968 (+ 81293us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:15.863342 (+ 46374us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1855485}
I20260928 07:56:15.864957 29041 tablet_replica.cc:333] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:15.865172 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 8d8fc8e85fc54877aa0c2afb5f3cbbc5 (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
I20260928 07:56:15.869365 29028 raft_consensus.cc:493] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:15.870424 29028 raft_consensus.cc:515] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.872344 28667 raft_consensus.cc:359] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.873106 28667 raft_consensus.cc:385] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:15.873425 28667 raft_consensus.cc:740] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:15.858814 27824 rpcz_store.cc:276] 0928 07:56:12.971346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.988453 (+ 17107us) service_pool.cc:224] Handling call
0928 07:56:13.197182 (+208729us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54000203d4. stack: 00007f6ecc595323 00007f6ecc595220 00007f6ecc139574 0000000000516964 00000000005168f9 00007f6ed36935c0 00007f6ed37326fa 00007f6ed54a3d8c 00007f6ed55a3566 00007f6ed314e034 00007f6ed314dfc2 00007f6ed314def1 00007f6ed314de6c 00007f6ed314d122 00007f6ed13f809c 00007f6ed13f74d6
0928 07:56:13.673153 (+475971us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:13.677167 (+ 4014us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:15.835689 (+2158522us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:15.857799 (+ 22110us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:15.858118 (+ 319us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:15.858444 (+ 326us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:15.840039 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:15.840423 (+ 384us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:15.840446 (+ 23us) write_op.cc:435] Acquired schema lock
0928 07:56:15.840458 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:15.840694 (+ 236us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:15.840732 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:15.840752 (+ 20us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:15.840969 (+ 217us) tablet.cc:701] Row locks acquired
0928 07:56:15.840981 (+ 12us) write_op.cc:260] PREPARE: finished
0928 07:56:15.841087 (+ 106us) write_op.cc:270] Start()
0928 07:56:15.841165 (+ 78us) write_op.cc:276] Timestamp: P: 1790582175840996 usec, L: 0
0928 07:56:15.841179 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 07:56:15.841785 (+ 606us) log.cc:844] Serialized 433 byte log entry
0928 07:56:15.855530 (+ 13745us) op_driver.cc:464] REPLICATION: finished
0928 07:56:15.855889 (+ 359us) write_op.cc:301] APPLY: starting
0928 07:56:15.855965 (+ 76us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:15.856084 (+ 119us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:15.856195 (+ 111us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:15.856595 (+ 400us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:15.856744 (+ 149us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:15.856806 (+ 62us) write_op.cc:312] APPLY: finished
0928 07:56:15.857027 (+ 221us) log.cc:844] Serialized 29 byte log entry
0928 07:56:15.857177 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:15.857268 (+ 91us) write_op.cc:454] Released schema lock
0928 07:56:15.857299 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:15.857517 (+ 218us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:15.857550 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1858738,"Hive Metastore.run_cpu_time_us":616,"Hive Metastore.run_wall_time_us":299173,"spinlock_wait_cycles":478183296,"child_traces":[["op",{"apply.queue_time_us":183,"apply.run_cpu_time_us":1610,"apply.run_wall_time_us":1610,"num_ops":2,"prepare.queue_time_us":2893,"prepare.run_cpu_time_us":1967,"prepare.run_wall_time_us":1966,"replication_time_us":14260}]]}
I20260928 07:56:15.874240 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec9ebafa7c248ceb280587e49d964b7" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:15.874817 28207 raft_consensus.cc:2468] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:15.875188 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet bbd54f8b0d9045bdad4c72d1c14c8af6 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:15.876968 28286 leader_election.cc:304] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:15.877751 29083 raft_consensus.cc:2804] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:15.878057 29083 raft_consensus.cc:493] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:15.878364 29083 raft_consensus.cc:3060] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.890374 28667 consensus_queue.cc:260] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.892745 28667 ts_tablet_manager.cc:1434] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.051s user 0.005s sys 0.000s
I20260928 07:56:15.893927 29041 raft_consensus.cc:2243] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:15.894606 29041 raft_consensus.cc:2272] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:15.895545 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet bbd54f8b0d9045bdad4c72d1c14c8af6
I20260928 07:56:15.897357 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet bbd54f8b0d9045bdad4c72d1c14c8af6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bc16584c61c4ebea9bdf4772630ef58) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:15.898284 29041 ts_tablet_manager.cc:1916] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:15.900077 27824 catalog_manager.cc:6934] ReplaceTablet: tablet bbd54f8b0d9045bdad4c72d1c14c8af6 deleted and replaced by tablet 4bc16584c61c4ebea9bdf4772630ef58
I20260928 07:56:15.900718 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet bbd54f8b0d9045bdad4c72d1c14c8af6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bc16584c61c4ebea9bdf4772630ef58) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:15.901134 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 657aa60685c740adbecdc1579270066e from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:15.911768 28667 tablet_bootstrap.cc:492] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:15.916482 29028 leader_election.cc:290] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:15.917550 28656 tablet_replica.cc:333] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:15.918299 28656 raft_consensus.cc:2243] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:15.919193 28656 raft_consensus.cc:2272] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:15.919698 29147 raft_consensus.cc:493] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:15.920111 29147 raft_consensus.cc:515] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.922350 29147 leader_election.cc:290] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:15.924032 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:15.925493 28142 leader_election.cc:343] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:15.926728 29083 raft_consensus.cc:515] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:15.927685 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 42897682db564e56b8e6bf8b75f8641c (DEFAULT_TABLE table=default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.928750 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42897682db564e56b8e6bf8b75f8641c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.929574 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec9ebafa7c248ceb280587e49d964b7" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:15.930138 28205 raft_consensus.cc:3060] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:15.934319 29083 leader_election.cc:290] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
W20260928 07:56:15.937527 28286 consensus_peers.cc:597] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f942bd0b3bbc4d908633722e32bf11b8. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:15.941568 28667 tablet_bootstrap.cc:654] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:15.942938 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 42897682db564e56b8e6bf8b75f8641c (DEFAULT_TABLE table=default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.943975 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42897682db564e56b8e6bf8b75f8641c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.958801 29151 raft_consensus.cc:493] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:15.959328 29151 raft_consensus.cc:515] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:15.959771 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 42897682db564e56b8e6bf8b75f8641c (DEFAULT_TABLE table=default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:15.960798 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42897682db564e56b8e6bf8b75f8641c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:15.961906 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet bbd54f8b0d9045bdad4c72d1c14c8af6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bc16584c61c4ebea9bdf4772630ef58) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:15.962188 29151 leader_election.cc:290] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:15.969265 28658 tablet_replica.cc:333] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:15.970196 28658 raft_consensus.cc:2243] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:15.824131 29097 raft_consensus.cc:697] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:15.970884 28658 raft_consensus.cc:2272] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:15.975312 28434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 158074us
I20260928 07:56:15.981886 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 657aa60685c740adbecdc1579270066e
I20260928 07:56:15.983757 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 657aa60685c740adbecdc1579270066e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a991fd5fd32408ba8e1065a855b06d3) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:15.921134 28656 ts_tablet_manager.cc:1916] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:15.985949 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 657aa60685c740adbecdc1579270066e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a991fd5fd32408ba8e1065a855b06d3) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:15.988013 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 657aa60685c740adbecdc1579270066e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a991fd5fd32408ba8e1065a855b06d3) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:15.989993 27824 catalog_manager.cc:6934] ReplaceTablet: tablet 657aa60685c740adbecdc1579270066e deleted and replaced by tablet 8a991fd5fd32408ba8e1065a855b06d3
I20260928 07:56:15.990412 28205 raft_consensus.cc:2468] T 7ec9ebafa7c248ceb280587e49d964b7 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:15.991467 29097 consensus_queue.cc:237] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.008553 28662 tablet_bootstrap.cc:492] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:16.009393 28658 ts_tablet_manager.cc:1916] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:16.009806 28286 leader_election.cc:304] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:16.011066 29028 raft_consensus.cc:2804] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:16.012477 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:16.013252 28204 raft_consensus.cc:2468] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:16.013528 29028 raft_consensus.cc:697] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:16.013820 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:16.014429 28655 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 07:56:16.014297 29028 consensus_queue.cc:237] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.018859 28662 tablet_bootstrap.cc:654] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.023439 28655 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 07:56:16.042624 28667 tablet_bootstrap.cc:492] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:16.043083 28667 ts_tablet_manager.cc:1403] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.134s user 0.005s sys 0.005s
I20260928 07:56:16.043399 28655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 07:56:16.045682 28667 raft_consensus.cc:359] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.046303 28667 raft_consensus.cc:385] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.046581 28667 raft_consensus.cc:740] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.047197 28667 consensus_queue.cc:260] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.053686 28496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.054524 28496 raft_consensus.cc:2468] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:16.062893 28666 tablet_bootstrap.cc:492] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:16.063347 28666 ts_tablet_manager.cc:1403] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.296s user 0.011s sys 0.000s
I20260928 07:56:16.063789 28662 tablet_bootstrap.cc:492] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:16.064186 28662 ts_tablet_manager.cc:1403] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.056s user 0.009s sys 0.003s
I20260928 07:56:16.066547 28662 raft_consensus.cc:359] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.067139 28662 raft_consensus.cc:385] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.067406 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec9ebafa7c248ceb280587e49d964b7" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.067610 28662 raft_consensus.cc:740] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.067962 28498 raft_consensus.cc:2468] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:16.068216 28662 consensus_queue.cc:260] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.070132 28662 ts_tablet_manager.cc:1434] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260928 07:56:16.077354 29041 ts_tablet_manager.cc:1929] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:16.077842 29041 log.cc:1199] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/7fa47d4f3bbb45f89a1750e512614b98
I20260928 07:56:16.078598 29041 ts_tablet_manager.cc:1950] T 7fa47d4f3bbb45f89a1750e512614b98 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:16.078650 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec9ebafa7c248ceb280587e49d964b7" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:16.078277 27826 catalog_manager.cc:5838] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:16.078735 27824 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_2a0111dbc5c34f6e9adeaff86b2c2769"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:16.079191 28498 raft_consensus.cc:3060] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.049106 28667 ts_tablet_manager.cc:1434] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 07:56:16.087118 28498 raft_consensus.cc:2468] T 7ec9ebafa7c248ceb280587e49d964b7 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:16.089190 28141 leader_election.cc:304] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:16.090377 29147 raft_consensus.cc:2804] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:16.090713 29147 raft_consensus.cc:493] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:16.091004 29147 raft_consensus.cc:3060] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.091176 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc16584c61c4ebea9bdf4772630ef58 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.092150 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc16584c61c4ebea9bdf4772630ef58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.098044 29147 raft_consensus.cc:515] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.099646 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc16584c61c4ebea9bdf4772630ef58 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.100786 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc16584c61c4ebea9bdf4772630ef58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.101245 29147 leader_election.cc:290] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:16.102402 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc16584c61c4ebea9bdf4772630ef58 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.103395 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc16584c61c4ebea9bdf4772630ef58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.104736 27828 catalog_manager.cc:2213] created HMS catalog entry for table [id=1367a86afa4a49bab81bb716c0bdf033]
W20260928 07:56:16.107280 28285 consensus_peers.cc:597] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 -> Peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Couldn't send request to peer bae11841a62f429a98a978de5b7bd60e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f942bd0b3bbc4d908633722e32bf11b8. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:16.109537 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
W20260928 07:56:16.110255 28434 leader_election.cc:343] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.116312 28666 raft_consensus.cc:359] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.116744 28667 tablet_bootstrap.cc:492] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:16.116855 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 136) took 2518 ms. Trace:
I20260928 07:56:16.117013 28666 raft_consensus.cc:385] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.117302 28666 raft_consensus.cc:740] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.117945 28666 consensus_queue.cc:260] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.117408 29041 rpcz_store.cc:276] 0928 07:56:13.589236 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:13.745860 (+156624us) service_pool.cc:224] Handling call
0928 07:56:15.864799 (+2118939us) ts_tablet_manager.cc:1151] Deleting tablet 7fa47d4f3bbb45f89a1750e512614b98
0928 07:56:15.864842 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:16.025514 (+160672us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.077174 (+ 51660us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.107152 (+ 29978us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2118100}
W20260928 07:56:16.121255 28142 leader_election.cc:343] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.121258 29119 consensus_queue.cc:1048] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:16.125753 29041 tablet_replica.cc:333] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:16.125953 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 7fa47d4f3bbb45f89a1750e512614b98 (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:16.128309 29041 raft_consensus.cc:2243] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:16.134482 28434 leader_election.cc:304] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980
I20260928 07:56:16.135818 29041 pending_rounds.cc:70] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 1 pending ops.
W20260928 07:56:16.145378 27816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.252:41205, user_credentials={real_user=slave}} blocked reactor thread for 83116.6us
I20260928 07:56:16.146926 29041 pending_rounds.cc:77] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224581031436288 op_type: NO_OP noop_request { }
I20260928 07:56:16.148567 29041 raft_consensus.cc:2889] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:16.151055 29041 raft_consensus.cc:2272] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.137914 28667 tablet_bootstrap.cc:654] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.153522 29119 raft_consensus.cc:2804] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:16.153846 29119 raft_consensus.cc:493] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:16.154129 29119 raft_consensus.cc:3060] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.155475 29041 ts_tablet_manager.cc:1916] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:16.161141 29119 raft_consensus.cc:515] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.163640 29119 leader_election.cc:290] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:16.176514 29147 raft_consensus.cc:493] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.176831 28667 tablet_bootstrap.cc:492] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:16.177309 28667 ts_tablet_manager.cc:1403] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.063s user 0.012s sys 0.003s
I20260928 07:56:16.177021 29147 raft_consensus.cc:515] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.179759 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9854b3eee6746188e47fe1b656130dd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:16.179677 28667 raft_consensus.cc:359] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.180346 28667 raft_consensus.cc:385] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.180603 28667 raft_consensus.cc:740] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
W20260928 07:56:16.181170 28142 leader_election.cc:343] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.182585 29147 leader_election.cc:290] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.183115 28666 ts_tablet_manager.cc:1434] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.120s user 0.003s sys 0.003s
I20260928 07:56:16.189338 28666 tablet_bootstrap.cc:492] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:16.194561 29028 raft_consensus.cc:493] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.195182 29028 raft_consensus.cc:515] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.198509 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac50af1b39345b8a75ba38ba06de5a1" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:16.199368 28204 raft_consensus.cc:2393] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bd67de620c94af3b7c8e3ba7d42f980 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:16.199208 28667 consensus_queue.cc:260] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.208205 28667 ts_tablet_manager.cc:1434] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.031s user 0.004s sys 0.001s
I20260928 07:56:16.211359 29028 leader_election.cc:290] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.222662 27828 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 104) took 3970 ms. Trace:
I20260928 07:56:16.227593 28662 tablet_bootstrap.cc:492] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:16.230049 28667 tablet_bootstrap.cc:492] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:16.233871 28662 tablet_bootstrap.cc:654] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.223075 27828 rpcz_store.cc:276] 0928 07:56:12.251949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.252545 (+ 596us) service_pool.cc:224] Handling call
0928 07:56:13.664397 (+1411852us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:13.679010 (+ 14613us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:16.104693 (+2425683us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:16.221859 (+117166us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:16.222205 (+ 346us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:16.222589 (+ 384us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:16.110788 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:16.111260 (+ 472us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:16.111294 (+ 34us) write_op.cc:435] Acquired schema lock
0928 07:56:16.111313 (+ 19us) tablet.cc:662] Decoding operations
0928 07:56:16.111660 (+ 347us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:16.111702 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:16.111721 (+ 19us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:16.111916 (+ 195us) tablet.cc:701] Row locks acquired
0928 07:56:16.111930 (+ 14us) write_op.cc:260] PREPARE: finished
0928 07:56:16.112047 (+ 117us) write_op.cc:270] Start()
0928 07:56:16.112130 (+ 83us) write_op.cc:276] Timestamp: P: 1790582176111981 usec, L: 0
0928 07:56:16.112146 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 07:56:16.112630 (+ 484us) log.cc:844] Serialized 433 byte log entry
0928 07:56:16.217705 (+105075us) op_driver.cc:464] REPLICATION: finished
0928 07:56:16.219022 (+ 1317us) write_op.cc:301] APPLY: starting
0928 07:56:16.219082 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:16.219212 (+ 130us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:16.219323 (+ 111us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:16.219695 (+ 372us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:16.219846 (+ 151us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:16.219889 (+ 43us) write_op.cc:312] APPLY: finished
0928 07:56:16.220074 (+ 185us) log.cc:844] Serialized 29 byte log entry
0928 07:56:16.220223 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:16.220286 (+ 63us) write_op.cc:454] Released schema lock
0928 07:56:16.220321 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:16.220531 (+ 210us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:16.220556 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2156172,"Hive Metastore.run_cpu_time_us":601,"Hive Metastore.run_wall_time_us":268633,"child_traces":[["op",{"apply.queue_time_us":1150,"apply.run_cpu_time_us":1488,"apply.run_wall_time_us":1488,"num_ops":2,"prepare.queue_time_us":4287,"prepare.run_cpu_time_us":2047,"prepare.run_wall_time_us":2048,"replication_time_us":105464}]]}
I20260928 07:56:16.239274 27828 master_service.cc:960] ReplaceTablet: received request to replace tablet f9c220bb07c945d8a8d8268543414dd6 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:16.242905 27826 master_service.cc:960] ReplaceTablet: received request to replace tablet dda49b3ac3104f47bbfc2c780282abca from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:16.244448 28667 tablet_bootstrap.cc:654] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.247879 28662 tablet_bootstrap.cc:492] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:16.248297 28662 ts_tablet_manager.cc:1403] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.000s
I20260928 07:56:16.250982 28662 raft_consensus.cc:359] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.251617 28662 raft_consensus.cc:385] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.255013 28662 raft_consensus.cc:740] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.257700 29041 ts_tablet_manager.cc:1929] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.258081 29041 log.cc:1199] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/87192a995cc84d5eade9c917de6b2b81
I20260928 07:56:16.258844 29041 ts_tablet_manager.cc:1950] T 87192a995cc84d5eade9c917de6b2b81 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:16.255821 28662 consensus_queue.cc:260] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.261615 29097 raft_consensus.cc:493] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.262154 29097 raft_consensus.cc:515] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.271092 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 140) took 2418 ms. Trace:
I20260928 07:56:16.276337 28662 ts_tablet_manager.cc:1434] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260928 07:56:16.278934 28656 ts_tablet_manager.cc:1929] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.279422 28656 log.cc:1199] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/bbd54f8b0d9045bdad4c72d1c14c8af6
I20260928 07:56:16.279979 29193 tablet.cc:1751] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:16.275804 29041 rpcz_store.cc:276] 0928 07:56:13.852522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:13.862510 (+ 9988us) service_pool.cc:224] Handling call
0928 07:56:16.125593 (+2263083us) ts_tablet_manager.cc:1151] Deleting tablet 87192a995cc84d5eade9c917de6b2b81
0928 07:56:16.125636 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:16.180208 (+ 54572us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.257563 (+ 77355us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.271031 (+ 13468us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262428}
W20260928 07:56:16.272018 28434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 137607us
I20260928 07:56:16.282287 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 87192a995cc84d5eade9c917de6b2b81 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
I20260928 07:56:16.282948 29194 tablet.cc:1751] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:16.284070 29041 tablet_replica.cc:333] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:16.281728 29097 leader_election.cc:290] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:16.288858 29041 raft_consensus.cc:2243] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:16.289112 29149 raft_consensus.cc:493] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.289592 29149 raft_consensus.cc:515] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.293398 29149 leader_election.cc:290] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.296029 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:16.296800 28204 raft_consensus.cc:2393] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:16.294723 29028 raft_consensus.cc:493] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.295655 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:16.297857 29028 raft_consensus.cc:515] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.299095 28350 raft_consensus.cc:3060] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.299440 28348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be116490ca57460688eaa2ff1c0415de" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:16.300040 28348 raft_consensus.cc:2468] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:16.300259 29028 leader_election.cc:290] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.301990 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:16.302742 28205 raft_consensus.cc:2393] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bd67de620c94af3b7c8e3ba7d42f980 in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:16.302011 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be116490ca57460688eaa2ff1c0415de" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:16.304877 28204 raft_consensus.cc:2468] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:16.302618 29041 raft_consensus.cc:2272] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.294167 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cf8015fec54fb7874e93717fc8d38b" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:16.307329 29041 ts_tablet_manager.cc:1916] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:16.307251 28142 leader_election.cc:343] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.310429 28496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac50af1b39345b8a75ba38ba06de5a1" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.311475 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.311882 28434 leader_election.cc:304] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:16.312227 28497 raft_consensus.cc:2393] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bd67de620c94af3b7c8e3ba7d42f980 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:16.312469 28495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64d9a4cd23460a8b311ced5acf4170" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:16.313186 28495 raft_consensus.cc:2393] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate acdaa3cf2ffd45f5b55a169c1bacead5 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:16.315233 28656 ts_tablet_manager.cc:1950] T bbd54f8b0d9045bdad4c72d1c14c8af6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:16.316771 28493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cf8015fec54fb7874e93717fc8d38b" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.317169 28141 leader_election.cc:304] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.318224 29149 raft_consensus.cc:2749] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 07:56:16.318603 28656 tablet_replica.cc:333] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:16.319290 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet bbd54f8b0d9045bdad4c72d1c14c8af6 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
I20260928 07:56:16.319487 28656 raft_consensus.cc:2243] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:16.313194 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9854b3eee6746188e47fe1b656130dd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.312588 29119 raft_consensus.cc:2804] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:16.321424 29119 raft_consensus.cc:493] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:16.321873 29119 raft_consensus.cc:3060] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.320345 28656 raft_consensus.cc:2272] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.286887 28667 tablet_bootstrap.cc:492] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:16.308707 28350 raft_consensus.cc:2468] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:16.315543 28285 leader_election.cc:304] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.333532 28667 ts_tablet_manager.cc:1403] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.005s
I20260928 07:56:16.334386 28285 leader_election.cc:304] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.335527 29028 raft_consensus.cc:3060] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.336429 28667 raft_consensus.cc:359] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.337066 28667 raft_consensus.cc:385] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.337355 28667 raft_consensus.cc:740] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.338055 28667 consensus_queue.cc:260] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.339107 29083 raft_consensus.cc:2749] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:16.339545 28658 ts_tablet_manager.cc:1929] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.340122 28658 log.cc:1199] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/bbd54f8b0d9045bdad4c72d1c14c8af6
I20260928 07:56:16.341003 28658 ts_tablet_manager.cc:1950] T bbd54f8b0d9045bdad4c72d1c14c8af6 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:16.341743 28667 ts_tablet_manager.cc:1434] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260928 07:56:16.343011 29084 raft_consensus.cc:493] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.343467 29084 raft_consensus.cc:515] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.345037 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet bbd54f8b0d9045bdad4c72d1c14c8af6 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
I20260928 07:56:16.346287 28658 tablet_replica.cc:333] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:16.347090 28658 raft_consensus.cc:2243] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:16.349576 27828 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet f9c220bb07c945d8a8d8268543414dd6
I20260928 07:56:16.351065 29084 leader_election.cc:290] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.351221 27828 catalog_manager.cc:6934] ReplaceTablet: tablet f9c220bb07c945d8a8d8268543414dd6 deleted and replaced by tablet 711949ab6f4548d09e06b849202d2d90
I20260928 07:56:16.352849 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet f9c220bb07c945d8a8d8268543414dd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 711949ab6f4548d09e06b849202d2d90) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:16.354043 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet f9c220bb07c945d8a8d8268543414dd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 711949ab6f4548d09e06b849202d2d90) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:16.355196 29028 raft_consensus.cc:2749] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 07:56:16.347985 28141 leader_election.cc:343] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.364059 28141 leader_election.cc:304] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
W20260928 07:56:16.365942 28141 leader_election.cc:343] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.366297 28141 leader_election.cc:304] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.366972 29147 raft_consensus.cc:2749] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:16.349000 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9854b3eee6746188e47fe1b656130dd" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:16.367583 28204 raft_consensus.cc:2468] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:16.367970 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet f9c220bb07c945d8a8d8268543414dd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 711949ab6f4548d09e06b849202d2d90) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:16.368258 29147 raft_consensus.cc:2749] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:16.369062 28286 leader_election.cc:304] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:16.370404 29028 raft_consensus.cc:2804] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:16.370666 28656 ts_tablet_manager.cc:1916] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:16.370774 29028 raft_consensus.cc:493] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:16.371155 29028 raft_consensus.cc:3060] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.371836 27822 catalog_manager.cc:5838] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:16.375754 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 8a991fd5fd32408ba8e1065a855b06d3 (DEFAULT_TABLE table=default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.379568 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 8a991fd5fd32408ba8e1065a855b06d3 (DEFAULT_TABLE table=default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.380652 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a991fd5fd32408ba8e1065a855b06d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.386196 28434 leader_election.cc:304] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:16.386935 29097 raft_consensus.cc:2804] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:16.387372 29097 raft_consensus.cc:697] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:16.388135 29097 consensus_queue.cc:237] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.387367 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a991fd5fd32408ba8e1065a855b06d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:16.393069 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260928 07:56:16.394516 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 8a991fd5fd32408ba8e1065a855b06d3 (DEFAULT_TABLE table=default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.395509 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a991fd5fd32408ba8e1065a855b06d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.394359 29028 raft_consensus.cc:515] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.405264 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9854b3eee6746188e47fe1b656130dd" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:16.405869 28204 raft_consensus.cc:3060] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.413439 28204 raft_consensus.cc:2468] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:16.414669 28286 leader_election.cc:304] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:16.415750 29084 raft_consensus.cc:2804] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:16.416293 29084 raft_consensus.cc:697] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:16.417066 29084 consensus_queue.cc:237] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.348184 28658 raft_consensus.cc:2272] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.425729 29028 leader_election.cc:290] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.428539 28658 ts_tablet_manager.cc:1916] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:16.347546 29119 raft_consensus.cc:515] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.436100 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9854b3eee6746188e47fe1b656130dd" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.437467 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9854b3eee6746188e47fe1b656130dd" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:16.439105 29119 leader_election.cc:290] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:16.439678 29119 consensus_queue.cc:1048] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:16.455201 29084 raft_consensus.cc:493] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.455693 29084 raft_consensus.cc:515] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.457719 29084 leader_election.cc:290] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.459415 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda49b3ac3104f47bbfc2c780282abca" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:16.460142 28204 raft_consensus.cc:2393] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bd67de620c94af3b7c8e3ba7d42f980 in current term 1: Already voted for candidate bae11841a62f429a98a978de5b7bd60e in this term.
I20260928 07:56:16.461720 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be116490ca57460688eaa2ff1c0415de" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:16.462275 28204 raft_consensus.cc:3060] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.464440 29203 tablet.cc:1751] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:16.468704 28204 raft_consensus.cc:2468] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:16.469769 28667 tablet_bootstrap.cc:492] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
W20260928 07:56:16.476140 28285 leader_election.cc:343] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:16.477308 28285 leader_election.cc:343] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.478688 29149 raft_consensus.cc:493] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.479369 28667 tablet_bootstrap.cc:654] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.479176 29149 raft_consensus.cc:515] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.481608 29149 leader_election.cc:290] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:16.482846 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42897682db564e56b8e6bf8b75f8641c" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:16.484301 28142 leader_election.cc:343] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.485980 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be116490ca57460688eaa2ff1c0415de" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:16.486555 28350 raft_consensus.cc:3060] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.494606 28350 raft_consensus.cc:2468] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:16.506999 28667 tablet_bootstrap.cc:492] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:16.507493 28667 ts_tablet_manager.cc:1403] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.003s
I20260928 07:56:16.508589 28434 leader_election.cc:304] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:16.509542 29051 raft_consensus.cc:2804] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:16.510020 29051 raft_consensus.cc:697] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:16.510814 29051 consensus_queue.cc:237] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.516077 28667 raft_consensus.cc:359] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.517663 28667 raft_consensus.cc:385] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.518324 28667 raft_consensus.cc:740] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.518412 27826 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet dda49b3ac3104f47bbfc2c780282abca
I20260928 07:56:16.519801 27826 catalog_manager.cc:6934] ReplaceTablet: tablet dda49b3ac3104f47bbfc2c780282abca deleted and replaced by tablet 48ed97fd35ee42f3957a18f48fac07bb
I20260928 07:56:16.520653 27826 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_dacc6ff6b7fa48c78a6b028734185c0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:16.520586 28667 consensus_queue.cc:260] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.524722 28656 ts_tablet_manager.cc:1929] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.524855 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet dda49b3ac3104f47bbfc2c780282abca with delete_type TABLET_DATA_DELETED (replaced by tablet 48ed97fd35ee42f3957a18f48fac07bb) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:16.525966 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet dda49b3ac3104f47bbfc2c780282abca with delete_type TABLET_DATA_DELETED (replaced by tablet 48ed97fd35ee42f3957a18f48fac07bb) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:16.531275 28667 ts_tablet_manager.cc:1434] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260928 07:56:16.532187 28667 tablet_bootstrap.cc:492] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:16.533766 28350 raft_consensus.cc:3060] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.539839 29041 ts_tablet_manager.cc:1929] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.540208 29041 log.cc:1199] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/608a4d03b3e341a2898ce42d86288d54
I20260928 07:56:16.540910 29041 ts_tablet_manager.cc:1950] T 608a4d03b3e341a2898ce42d86288d54 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:16.546654 28662 tablet_bootstrap.cc:492] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:16.552641 28662 tablet_bootstrap.cc:654] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.556474 28666 tablet_bootstrap.cc:654] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.525097 28656 log.cc:1199] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/657aa60685c740adbecdc1579270066e
I20260928 07:56:16.562719 28656 ts_tablet_manager.cc:1950] T 657aa60685c740adbecdc1579270066e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:16.563977 28656 tablet_replica.cc:333] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:16.563941 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42897682db564e56b8e6bf8b75f8641c" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.564229 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 657aa60685c740adbecdc1579270066e (table default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]) successfully deleted
I20260928 07:56:16.564703 28656 raft_consensus.cc:2243] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 07:56:16.566038 28141 leader_election.cc:343] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.565964 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda49b3ac3104f47bbfc2c780282abca" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.566421 28141 leader_election.cc:304] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.567423 29149 raft_consensus.cc:2749] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:16.569751 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 143) took 2301 ms. Trace:
I20260928 07:56:16.570065 29041 rpcz_store.cc:276] 0928 07:56:14.268062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:14.268189 (+ 127us) service_pool.cc:224] Handling call
0928 07:56:16.283910 (+2015721us) ts_tablet_manager.cc:1151] Deleting tablet 608a4d03b3e341a2898ce42d86288d54
0928 07:56:16.283953 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:16.466839 (+182886us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.539717 (+ 72878us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.569685 (+ 29968us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1915745}
I20260928 07:56:16.571334 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 608a4d03b3e341a2898ce42d86288d54 (table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]) successfully deleted
I20260928 07:56:16.572268 28667 tablet_bootstrap.cc:654] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.576231 28656 raft_consensus.cc:2272] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.578136 28656 ts_tablet_manager.cc:1916] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:16.581550 27829 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]
I20260928 07:56:16.598922 29041 tablet_replica.cc:333] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:16.599714 29041 raft_consensus.cc:2243] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:16.600186 29041 raft_consensus.cc:2272] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.605408 29041 ts_tablet_manager.cc:1916] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:16.611191 28667 tablet_bootstrap.cc:492] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:16.611665 28667 ts_tablet_manager.cc:1403] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.080s user 0.009s sys 0.001s
I20260928 07:56:16.618252 28285 leader_election.cc:304] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.614225 28667 raft_consensus.cc:359] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.622368 28667 raft_consensus.cc:385] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.622668 28667 raft_consensus.cc:740] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.624068 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet dda49b3ac3104f47bbfc2c780282abca with delete_type TABLET_DATA_DELETED (replaced by tablet 48ed97fd35ee42f3957a18f48fac07bb) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:16.629541 28667 consensus_queue.cc:260] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:16.631632 28662 tablet_bootstrap.cc:492] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:16.640949 28667 ts_tablet_manager.cc:1434] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260928 07:56:16.648123 28667 tablet_bootstrap.cc:492] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:16.654861 28662 ts_tablet_manager.cc:1403] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.108s user 0.013s sys 0.000s
I20260928 07:56:16.654803 29084 raft_consensus.cc:493] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.655299 29084 raft_consensus.cc:515] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.659791 29083 raft_consensus.cc:2749] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:16.661530 29084 leader_election.cc:290] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.663480 28666 tablet_bootstrap.cc:492] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:16.663897 28666 ts_tablet_manager.cc:1403] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.480s user 0.008s sys 0.021s
I20260928 07:56:16.666317 28666 raft_consensus.cc:359] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.666930 28666 raft_consensus.cc:385] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.667151 28666 raft_consensus.cc:740] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.667795 28666 consensus_queue.cc:260] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.670408 28666 ts_tablet_manager.cc:1434] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260928 07:56:16.671219 28666 tablet_bootstrap.cc:492] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:16.675487 28662 raft_consensus.cc:359] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.676121 28662 raft_consensus.cc:385] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.676379 28662 raft_consensus.cc:740] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.677635 29149 raft_consensus.cc:493] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.678054 29149 raft_consensus.cc:515] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.679075 28656 ts_tablet_manager.cc:1929] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.679464 28656 log.cc:1199] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/f9c220bb07c945d8a8d8268543414dd6
I20260928 07:56:16.681852 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc16584c61c4ebea9bdf4772630ef58" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:16.680050 29149 leader_election.cc:290] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.683889 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc16584c61c4ebea9bdf4772630ef58" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.683086 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cf8015fec54fb7874e93717fc8d38b" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:16.683405 28142 leader_election.cc:343] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.684899 28656 ts_tablet_manager.cc:1950] T f9c220bb07c945d8a8d8268543414dd6 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:16.685577 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cf8015fec54fb7874e93717fc8d38b" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.689206 28478 tablet_service.cc:1511] Processing CreateTablet for tablet f7489fefeac8420f973245e1b1bb2d6d (DEFAULT_TABLE table=default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 07:56:16.689961 28285 leader_election.cc:343] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.690480 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7489fefeac8420f973245e1b1bb2d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.688510 27828 catalog_manager.cc:5838] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:16.692476 27828 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet c213348428a04c479f871d390b7e3c95 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:16.695066 29041 ts_tablet_manager.cc:1929] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.695469 29041 log.cc:1199] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/93bcaa047c2b46f69b6c686e95053c1c
I20260928 07:56:16.696214 29041 ts_tablet_manager.cc:1950] T 93bcaa047c2b46f69b6c686e95053c1c P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:16.698266 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 147) took 1842 ms. Trace:
I20260928 07:56:16.698835 29041 rpcz_store.cc:276] 0928 07:56:14.856196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:14.856342 (+ 146us) service_pool.cc:224] Handling call
0928 07:56:16.598749 (+1742407us) ts_tablet_manager.cc:1151] Deleting tablet 93bcaa047c2b46f69b6c686e95053c1c
0928 07:56:16.598793 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:16.645490 (+ 46697us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.694930 (+ 49440us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.698203 (+ 3273us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1741816}
I20260928 07:56:16.698565 28204 raft_consensus.cc:2468] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:16.700021 29041 tablet_replica.cc:333] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:16.700866 29041 raft_consensus.cc:2243] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:16.701799 29041 raft_consensus.cc:2272] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.702368 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 93bcaa047c2b46f69b6c686e95053c1c (table default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]) successfully deleted
I20260928 07:56:16.697033 28331 tablet_service.cc:1511] Processing CreateTablet for tablet f7489fefeac8420f973245e1b1bb2d6d (DEFAULT_TABLE table=default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.704026 29041 ts_tablet_manager.cc:1916] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:16.686935 28141 leader_election.cc:343] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.704540 28141 leader_election.cc:304] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.706064 28656 tablet_replica.cc:333] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:16.706588 28286 leader_election.cc:304] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.706820 28656 raft_consensus.cc:2243] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:16.707635 29084 raft_consensus.cc:2804] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:16.707947 29084 raft_consensus.cc:493] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:16.708227 29084 raft_consensus.cc:3060] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.709609 29149 raft_consensus.cc:2749] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:16.710621 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet f9c220bb07c945d8a8d8268543414dd6 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]) successfully deleted
I20260928 07:56:16.704088 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7489fefeac8420f973245e1b1bb2d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.707301 28656 raft_consensus.cc:2272] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.715606 28656 ts_tablet_manager.cc:1916] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:16.725077 28184 tablet_service.cc:1511] Processing CreateTablet for tablet f7489fefeac8420f973245e1b1bb2d6d (DEFAULT_TABLE table=default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.729935 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7489fefeac8420f973245e1b1bb2d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.745980 27822 catalog_manager.cc:6391] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264] alter complete (version 1)
I20260928 07:56:16.747782 29149 consensus_queue.cc:1048] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:16.725028 28667 tablet_bootstrap.cc:654] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.767086 29084 raft_consensus.cc:515] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.752918 27822 catalog_manager.cc:5838] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:16.764012 27828 master_service.cc:960] ReplaceTablet: received request to replace tablet f9854b3eee6746188e47fe1b656130dd from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:16.770706 28667 tablet_bootstrap.cc:492] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:16.774935 28667 ts_tablet_manager.cc:1403] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.127s user 0.008s sys 0.004s
I20260928 07:56:16.777990 28667 raft_consensus.cc:359] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.778666 28667 raft_consensus.cc:385] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:16.778918 28667 raft_consensus.cc:740] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:16.779709 28667 consensus_queue.cc:260] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.788544 28667 ts_tablet_manager.cc:1434] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260928 07:56:16.789322 27825 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]
I20260928 07:56:16.794239 28667 tablet_bootstrap.cc:492] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:16.800771 28092 catalog_manager.cc:2811] Deleting table default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71] in response to Hive Metastore notification log event 39
I20260928 07:56:16.810192 29083 consensus_queue.cc:1048] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:16.798643 29041 ts_tablet_manager.cc:1929] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.817162 29041 log.cc:1199] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/f942bd0b3bbc4d908633722e32bf11b8
I20260928 07:56:16.821882 28667 tablet_bootstrap.cc:654] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:16.819919 29041 ts_tablet_manager.cc:1950] T f942bd0b3bbc4d908633722e32bf11b8 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:16.825136 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cf8015fec54fb7874e93717fc8d38b" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:16.825760 28204 raft_consensus.cc:3060] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.829269 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cf8015fec54fb7874e93717fc8d38b" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:16.830704 28285 leader_election.cc:343] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.835562 29084 leader_election.cc:290] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.837059 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 148) took 1766 ms. Trace:
I20260928 07:56:16.838431 29041 rpcz_store.cc:276] 0928 07:56:15.070455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:15.070600 (+ 145us) service_pool.cc:224] Handling call
0928 07:56:16.699864 (+1629264us) ts_tablet_manager.cc:1151] Deleting tablet f942bd0b3bbc4d908633722e32bf11b8
0928 07:56:16.699906 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:16.765796 (+ 65890us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.798474 (+ 32678us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.836992 (+ 38518us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1628599}
I20260928 07:56:16.839727 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet f942bd0b3bbc4d908633722e32bf11b8 (table default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]) successfully deleted
I20260928 07:56:16.842077 29041 tablet_replica.cc:333] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:16.843811 29041 raft_consensus.cc:2243] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:16.845135 29041 raft_consensus.cc:2272] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:16.847978 29041 ts_tablet_manager.cc:1916] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:16.852833 28662 consensus_queue.cc:260] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.843770 28204 raft_consensus.cc:2468] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:16.862267 28286 leader_election.cc:304] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.863535 29084 raft_consensus.cc:2804] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:16.864025 29084 raft_consensus.cc:697] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:16.864837 29084 consensus_queue.cc:237] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.880551 29149 consensus_queue.cc:1048] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 07:56:16.881024 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet dda49b3ac3104f47bbfc2c780282abca consensus state has no leader
I20260928 07:56:16.885008 28662 ts_tablet_manager.cc:1434] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.230s user 0.006s sys 0.000s
I20260928 07:56:16.894758 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 711949ab6f4548d09e06b849202d2d90 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.896003 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711949ab6f4548d09e06b849202d2d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.896049 28658 ts_tablet_manager.cc:1929] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.896399 28658 log.cc:1199] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/657aa60685c740adbecdc1579270066e
I20260928 07:56:16.895711 27828 catalog_manager.cc:5838] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:16.891871 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 711949ab6f4548d09e06b849202d2d90 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:16.902155 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711949ab6f4548d09e06b849202d2d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:16.893036 29119 consensus_queue.cc:1048] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:16.909368 29149 raft_consensus.cc:493] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.909940 29149 raft_consensus.cc:515] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.912850 29149 leader_election.cc:290] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.921566 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a991fd5fd32408ba8e1065a855b06d3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:16.923463 28141 leader_election.cc:343] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.924909 29028 consensus_queue.cc:1048] T 7ec9ebafa7c248ceb280587e49d964b7 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:16.924299 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a991fd5fd32408ba8e1065a855b06d3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:16.926352 28142 leader_election.cc:343] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.926818 28142 leader_election.cc:304] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.927980 29149 raft_consensus.cc:2749] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:16.927174 27828 catalog_manager.cc:5838] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:16.936074 28092 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet f9854b3eee6746188e47fe1b656130dd
I20260928 07:56:16.938499 28327 tablet_service.cc:1558] Processing DeleteTablet for tablet f9854b3eee6746188e47fe1b656130dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:16 UTC) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:16.940016 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet f9854b3eee6746188e47fe1b656130dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:16 UTC) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:16.942236 29119 consensus_queue.cc:1048] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:16.951009 28092 catalog_manager.cc:2811] Deleting table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9] in response to Hive Metastore notification log event 40
I20260928 07:56:16.966353 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet f9854b3eee6746188e47fe1b656130dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:16 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:16.968945 29228 raft_consensus.cc:493] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:16.969455 29228 raft_consensus.cc:515] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.971725 29228 leader_election.cc:290] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:16.974246 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc16584c61c4ebea9bdf4772630ef58" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:16.975188 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc16584c61c4ebea9bdf4772630ef58" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:16.975847 28205 raft_consensus.cc:2468] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
W20260928 07:56:16.976965 28285 leader_election.cc:343] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:16.978060 28286 leader_election.cc:304] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:16.979329 29228 raft_consensus.cc:2804] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:16.979785 29228 raft_consensus.cc:493] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:16.980162 29228 raft_consensus.cc:3060] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:16.981721 29041 ts_tablet_manager.cc:1929] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:16.982076 29041 log.cc:1199] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/a97ca287aa0e4ffcb387cc1c144a5a31
I20260928 07:56:16.982779 29041 ts_tablet_manager.cc:1950] T a97ca287aa0e4ffcb387cc1c144a5a31 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:16.984727 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 152) took 1526 ms. Trace:
I20260928 07:56:16.985033 29041 rpcz_store.cc:276] 0928 07:56:15.458457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:15.458586 (+ 129us) service_pool.cc:224] Handling call
0928 07:56:16.841861 (+1383275us) ts_tablet_manager.cc:1151] Deleting tablet a97ca287aa0e4ffcb387cc1c144a5a31
0928 07:56:16.841921 (+ 60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:16.948361 (+106440us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.981574 (+ 33213us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.984668 (+ 3094us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382699}
I20260928 07:56:16.986847 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet a97ca287aa0e4ffcb387cc1c144a5a31 (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]) successfully deleted
I20260928 07:56:16.988826 28667 tablet_bootstrap.cc:492] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:16.989295 28667 ts_tablet_manager.cc:1403] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.195s user 0.018s sys 0.006s
I20260928 07:56:16.991736 28667 raft_consensus.cc:359] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:16.986754 29041 tablet_replica.cc:333] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:17.005913 29041 raft_consensus.cc:2243] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.006497 29041 raft_consensus.cc:2272] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.008368 29041 ts_tablet_manager.cc:1916] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.014824 29084 raft_consensus.cc:493] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:17.015345 29084 raft_consensus.cc:515] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.017262 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 711949ab6f4548d09e06b849202d2d90 (DEFAULT_TABLE table=default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.018481 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711949ab6f4548d09e06b849202d2d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.018723 29084 leader_election.cc:290] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:17.031296 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42897682db564e56b8e6bf8b75f8641c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:17.031401 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42897682db564e56b8e6bf8b75f8641c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:17.031967 28205 raft_consensus.cc:2468] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
W20260928 07:56:17.032577 28285 leader_election.cc:343] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:17.033128 28286 leader_election.cc:304] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:17.034555 29084 raft_consensus.cc:2804] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:17.034924 29084 raft_consensus.cc:493] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:17.035288 29084 raft_consensus.cc:3060] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:17.043619 29084 raft_consensus.cc:515] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.046304 29084 leader_election.cc:290] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:17.047829 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42897682db564e56b8e6bf8b75f8641c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:17.048600 28205 raft_consensus.cc:3060] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:17.055337 29041 ts_tablet_manager.cc:1929] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.055724 29041 log.cc:1199] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/bbd54f8b0d9045bdad4c72d1c14c8af6
I20260928 07:56:17.056613 29041 ts_tablet_manager.cc:1950] T bbd54f8b0d9045bdad4c72d1c14c8af6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:17.059042 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 154) took 1160 ms. Trace:
I20260928 07:56:17.059427 29041 rpcz_store.cc:276] 0928 07:56:15.899108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:15.900576 (+ 1468us) service_pool.cc:224] Handling call
0928 07:56:16.986534 (+1085958us) ts_tablet_manager.cc:1151] Deleting tablet bbd54f8b0d9045bdad4c72d1c14c8af6
0928 07:56:16.986589 (+ 55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:17.030542 (+ 43953us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.055204 (+ 24662us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.058963 (+ 3759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5335,"tablet-delete.queue_time_us":1085398}
I20260928 07:56:17.061206 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet bbd54f8b0d9045bdad4c72d1c14c8af6 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
I20260928 07:56:17.062765 29228 raft_consensus.cc:515] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.063225 29119 consensus_queue.cc:1048] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:17.067440 28658 ts_tablet_manager.cc:1950] T 657aa60685c740adbecdc1579270066e P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:17.070261 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 169) took 1084 ms. Trace:
I20260928 07:56:17.112461 28205 raft_consensus.cc:2468] T 42897682db564e56b8e6bf8b75f8641c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:17.067814 29041 tablet_replica.cc:333] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:17.138813 29041 raft_consensus.cc:2243] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.134509 28286 leader_election.cc:304] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:17.139536 29228 leader_election.cc:290] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:17.140120 29228 raft_consensus.cc:2804] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:17.140601 29228 raft_consensus.cc:697] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:17.139509 29041 raft_consensus.cc:2272] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.143728 29041 ts_tablet_manager.cc:1916] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.152314 28662 tablet_bootstrap.cc:492] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:17.157091 28658 rpcz_store.cc:276] 0928 07:56:15.985627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:15.985774 (+ 147us) service_pool.cc:224] Handling call
0928 07:56:16.346056 (+360282us) ts_tablet_manager.cc:1151] Deleting tablet 657aa60685c740adbecdc1579270066e
0928 07:56:16.346098 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:16.544011 (+197913us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:16.895926 (+351915us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.070176 (+174250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":359689}
I20260928 07:56:17.158774 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 657aa60685c740adbecdc1579270066e (table default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]) successfully deleted
I20260928 07:56:17.083014 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42897682db564e56b8e6bf8b75f8641c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:17.143113 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc16584c61c4ebea9bdf4772630ef58" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:17.161868 28285 leader_election.cc:343] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:17.162863 28285 leader_election.cc:343] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:17.163910 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc16584c61c4ebea9bdf4772630ef58" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:17.164616 28204 raft_consensus.cc:3060] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:17.165989 28662 tablet_bootstrap.cc:654] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.176024 28204 raft_consensus.cc:2468] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:17.177646 28286 leader_election.cc:304] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:17.178985 29084 raft_consensus.cc:2804] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:17.180150 29084 raft_consensus.cc:697] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:17.180963 29084 consensus_queue.cc:237] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.184737 29041 ts_tablet_manager.cc:1929] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.185282 29041 log.cc:1199] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/657aa60685c740adbecdc1579270066e
I20260928 07:56:17.185840 28656 ts_tablet_manager.cc:1929] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.186053 29041 ts_tablet_manager.cc:1950] T 657aa60685c740adbecdc1579270066e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:17.188396 29041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 156) took 1200 ms. Trace:
I20260928 07:56:17.188905 29041 rpcz_store.cc:276] 0928 07:56:15.987719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:15.987856 (+ 137us) service_pool.cc:224] Handling call
0928 07:56:17.067661 (+1079805us) ts_tablet_manager.cc:1151] Deleting tablet 657aa60685c740adbecdc1579270066e
0928 07:56:17.067703 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:17.169059 (+101356us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.184561 (+ 15502us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.188232 (+ 3671us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079206}
I20260928 07:56:17.191306 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 657aa60685c740adbecdc1579270066e (table default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]) successfully deleted
I20260928 07:56:17.192328 29041 tablet_replica.cc:333] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:17.193040 29041 raft_consensus.cc:2243] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.193555 29041 raft_consensus.cc:2272] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.197155 29041 ts_tablet_manager.cc:1916] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.203123 29119 raft_consensus.cc:493] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:17.203655 29119 raft_consensus.cc:515] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.205787 29119 leader_election.cc:290] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
W20260928 07:56:17.206935 28434 consensus_peers.cc:597] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9c220bb07c945d8a8d8268543414dd6. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:17.181437 28092 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 3b4dae7924a74f0bbdd5bfb4c34be90e
I20260928 07:56:17.211241 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:16 UTC) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:17.212630 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:16 UTC) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:17.214442 27820 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a5ebdbbec89645fe963b774cb3b57dae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:17.215350 29041 ts_tablet_manager.cc:1929] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.215718 29041 log.cc:1199] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/f9c220bb07c945d8a8d8268543414dd6
I20260928 07:56:17.216107 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9854b3eee6746188e47fe1b656130dd" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:17.216537 29041 ts_tablet_manager.cc:1950] T f9c220bb07c945d8a8d8268543414dd6 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
W20260928 07:56:17.214401 27823 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_569bbac4a1954d0bb6993bcd887049cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 07:56:17.222697 27824 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2a0111dbc5c34f6e9adeaff86b2c2769 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:17.223685 27821 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 105) took 4937 ms. Trace:
I20260928 07:56:17.224017 27821 rpcz_store.cc:276] 0928 07:56:12.286186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:12.286311 (+ 125us) service_pool.cc:224] Handling call
0928 07:56:13.665462 (+1379151us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:17.221864 (+3556402us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:17.222845 (+ 981us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:17.223621 (+ 776us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1031485,"Hive Metastore.run_cpu_time_us":1826,"Hive Metastore.run_wall_time_us":838532}
I20260928 07:56:17.224638 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet f9c220bb07c945d8a8d8268543414dd6 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]) successfully deleted
I20260928 07:56:17.148087 28666 tablet_bootstrap.cc:654] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.225741 29041 tablet_replica.cc:333] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:17.226644 29041 raft_consensus.cc:2243] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.227175 29041 raft_consensus.cc:2272] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.229019 28658 tablet_replica.cc:333] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:17.229758 29041 ts_tablet_manager.cc:1916] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.229895 28658 raft_consensus.cc:2243] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:17.231004 28658 raft_consensus.cc:2272] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.232710 29228 consensus_queue.cc:237] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.208648 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9854b3eee6746188e47fe1b656130dd" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:17.236068 28656 log.cc:1199] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/dda49b3ac3104f47bbfc2c780282abca
I20260928 07:56:17.236373 28204 raft_consensus.cc:2393] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in this term.
I20260928 07:56:17.236788 28656 ts_tablet_manager.cc:1950] T dda49b3ac3104f47bbfc2c780282abca P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:17.209915 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b4dae7924a74f0bbdd5bfb4c34be90e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:16 UTC) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:17.237483 28434 leader_election.cc:304] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:17.229247 28662 tablet_bootstrap.cc:492] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:17.238577 28662 ts_tablet_manager.cc:1403] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.086s user 0.010s sys 0.000s
I20260928 07:56:17.239883 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:17.241142 28662 raft_consensus.cc:359] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.242204 29119 raft_consensus.cc:3060] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:17.245573 27822 catalog_manager.cc:5838] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:16.992360 28667 raft_consensus.cc:385] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.251120 28667 raft_consensus.cc:740] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.251998 28667 consensus_queue.cc:260] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.254051 28667 ts_tablet_manager.cc:1434] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.264s user 0.004s sys 0.001s
I20260928 07:56:17.258219 29119 raft_consensus.cc:2749] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:17.259186 29097 consensus_queue.cc:1048] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:17.241803 28662 raft_consensus.cc:385] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.265471 28662 raft_consensus.cc:740] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.266215 28662 consensus_queue.cc:260] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.281275 28662 ts_tablet_manager.cc:1434] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20260928 07:56:17.295624 28666 tablet_bootstrap.cc:492] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:17.295765 28662 tablet_bootstrap.cc:492] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:17.334703 28656 tablet_replica.cc:333] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:17.256904 29041 ts_tablet_manager.cc:1929] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.335583 29041 log.cc:1199] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/dda49b3ac3104f47bbfc2c780282abca
I20260928 07:56:17.336241 28666 ts_tablet_manager.cc:1403] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.665s user 0.009s sys 0.002s
I20260928 07:56:17.336421 29041 ts_tablet_manager.cc:1950] T dda49b3ac3104f47bbfc2c780282abca P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:17.338011 28667 tablet_bootstrap.cc:492] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:17.340545 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:17.347711 28666 raft_consensus.cc:359] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.348598 28656 raft_consensus.cc:2243] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.338798 29041 tablet_replica.cc:333] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:17.351838 29041 raft_consensus.cc:2243] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:17.352540 29041 pending_rounds.cc:70] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 1 pending ops.
I20260928 07:56:17.352770 29041 pending_rounds.cc:77] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224594611998720 op_type: NO_OP noop_request { }
I20260928 07:56:17.353127 29041 raft_consensus.cc:2889] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:17.353494 29041 raft_consensus.cc:2272] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.355108 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet f9854b3eee6746188e47fe1b656130dd from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:17.356330 29041 ts_tablet_manager.cc:1916] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.356612 28656 raft_consensus.cc:2272] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.357097 27821 master_service.cc:960] ReplaceTablet: received request to replace tablet 4bc16584c61c4ebea9bdf4772630ef58 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:17.358582 28656 ts_tablet_manager.cc:1916] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.359947 28662 tablet_bootstrap.cc:654] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.384377 29041 ts_tablet_manager.cc:1929] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.384775 29041 log.cc:1199] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/f9854b3eee6746188e47fe1b656130dd
I20260928 07:56:17.385519 29041 ts_tablet_manager.cc:1950] T f9854b3eee6746188e47fe1b656130dd P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:17.388160 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet f9854b3eee6746188e47fe1b656130dd (table default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]) successfully deleted
I20260928 07:56:17.391224 28662 tablet_bootstrap.cc:492] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:17.391676 28662 ts_tablet_manager.cc:1403] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.096s user 0.013s sys 0.000s
I20260928 07:56:17.391810 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 48ed97fd35ee42f3957a18f48fac07bb (DEFAULT_TABLE table=default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.392846 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ed97fd35ee42f3957a18f48fac07bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.396018 28662 raft_consensus.cc:359] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.396656 28662 raft_consensus.cc:385] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.396924 28662 raft_consensus.cc:740] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.327497 29097 consensus_queue.cc:1048] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:17.397615 28662 consensus_queue.cc:260] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.398006 28666 raft_consensus.cc:385] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.398283 28666 raft_consensus.cc:740] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.398859 28666 consensus_queue.cc:260] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.399468 28662 ts_tablet_manager.cc:1434] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260928 07:56:17.400769 28666 ts_tablet_manager.cc:1434] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.055s user 0.002s sys 0.001s
I20260928 07:56:17.394076 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 48ed97fd35ee42f3957a18f48fac07bb (DEFAULT_TABLE table=default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.404184 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ed97fd35ee42f3957a18f48fac07bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.387881 29041 tablet_replica.cc:333] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:17.417652 27821 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 4bc16584c61c4ebea9bdf4772630ef58
I20260928 07:56:17.418020 29041 raft_consensus.cc:2243] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.418501 29041 raft_consensus.cc:2272] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.420080 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc16584c61c4ebea9bdf4772630ef58 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b6fa66d29ca41b0b0d7ad8f30596aab) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:17.420291 29041 ts_tablet_manager.cc:1916] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.421991 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc16584c61c4ebea9bdf4772630ef58 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b6fa66d29ca41b0b0d7ad8f30596aab) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:17.422575 27821 catalog_manager.cc:6934] ReplaceTablet: tablet 4bc16584c61c4ebea9bdf4772630ef58 deleted and replaced by tablet 9b6fa66d29ca41b0b0d7ad8f30596aab
I20260928 07:56:17.423496 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc16584c61c4ebea9bdf4772630ef58 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b6fa66d29ca41b0b0d7ad8f30596aab) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:17.436839 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet dda49b3ac3104f47bbfc2c780282abca with delete_type TABLET_DATA_DELETED (replaced by tablet 48ed97fd35ee42f3957a18f48fac07bb) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:17.438337 27821 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_33b6d1f71f5b44d0aec9c0f698e7d014" } new_table_name: "default.Table_da656d08cd28419b8599a14b3946a15a" modify_external_catalogs: true
I20260928 07:56:17.333853 28658 ts_tablet_manager.cc:1916] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.396107 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 48ed97fd35ee42f3957a18f48fac07bb (DEFAULT_TABLE table=default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.439935 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ed97fd35ee42f3957a18f48fac07bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.453081 29257 raft_consensus.cc:493] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:17.453568 29257 raft_consensus.cc:515] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.455737 29257 leader_election.cc:290] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:17.457978 29041 ts_tablet_manager.cc:1929] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.457842 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cf8015fec54fb7874e93717fc8d38b" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:17.458359 29041 log.cc:1199] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/3b4dae7924a74f0bbdd5bfb4c34be90e
I20260928 07:56:17.459149 29041 ts_tablet_manager.cc:1950] T 3b4dae7924a74f0bbdd5bfb4c34be90e P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:17.460356 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cf8015fec54fb7874e93717fc8d38b" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:17.461068 28204 raft_consensus.cc:2393] T d9cf8015fec54fb7874e93717fc8d38b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in this term.
I20260928 07:56:17.461799 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 3b4dae7924a74f0bbdd5bfb4c34be90e (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
I20260928 07:56:17.462332 28434 leader_election.cc:304] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:17.463423 29257 raft_consensus.cc:3060] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:17.474810 28667 tablet_bootstrap.cc:654] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.477670 29041 tablet_replica.cc:333] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:17.478513 29041 raft_consensus.cc:2243] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:17.479240 29041 pending_rounds.cc:70] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Trying to abort 1 pending ops.
I20260928 07:56:17.479472 29041 pending_rounds.cc:77] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334224597742448640 op_type: NO_OP noop_request { }
I20260928 07:56:17.479821 29041 raft_consensus.cc:2889] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 07:56:17.480163 29041 raft_consensus.cc:2272] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.482769 29041 ts_tablet_manager.cc:1916] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.487026 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 07:56:17.488229 28434 consensus_peers.cc:597] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dda49b3ac3104f47bbfc2c780282abca. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:17.488472 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.488679 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.489768 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.490918 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.491917 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.507884 27822 catalog_manager.cc:5838] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:17.516830 29119 consensus_queue.cc:1048] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:17.532239 29257 raft_consensus.cc:2749] T d9cf8015fec54fb7874e93717fc8d38b P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:17.535650 28666 tablet_bootstrap.cc:492] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:17.564770 29051 consensus_queue.cc:1048] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:17.571228 28667 tablet_bootstrap.cc:492] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:17.571815 28667 ts_tablet_manager.cc:1403] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.234s user 0.007s sys 0.002s
I20260928 07:56:17.574285 28667 raft_consensus.cc:359] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.574926 28667 raft_consensus.cc:385] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.575169 28667 raft_consensus.cc:740] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.591406 28662 tablet_bootstrap.cc:492] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:17.593509 29041 ts_tablet_manager.cc:1929] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.593912 29041 log.cc:1199] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/4bc16584c61c4ebea9bdf4772630ef58
I20260928 07:56:17.595376 28667 consensus_queue.cc:260] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.600013 28662 tablet_bootstrap.cc:654] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.603148 29041 ts_tablet_manager.cc:1950] T 4bc16584c61c4ebea9bdf4772630ef58 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:17.606499 28667 ts_tablet_manager.cc:1434] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.034s user 0.007s sys 0.001s
I20260928 07:56:17.608266 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 4bc16584c61c4ebea9bdf4772630ef58 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
I20260928 07:56:17.614822 28667 tablet_bootstrap.cc:492] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:17.618129 28662 tablet_bootstrap.cc:492] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:17.618613 28662 ts_tablet_manager.cc:1403] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.027s user 0.012s sys 0.002s
W20260928 07:56:17.621017 27815 catalog_manager.cc:5030] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet dda49b3ac3104f47bbfc2c780282abca because the tablet was not found. No further retry: Not found: Tablet not found: dda49b3ac3104f47bbfc2c780282abca
I20260928 07:56:17.624706 28667 tablet_bootstrap.cc:654] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.621003 28662 raft_consensus.cc:359] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.625484 28662 raft_consensus.cc:385] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.625810 28662 raft_consensus.cc:740] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.626562 28662 consensus_queue.cc:260] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.631951 28662 ts_tablet_manager.cc:1434] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260928 07:56:17.635108 29228 raft_consensus.cc:493] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:17.635663 29228 raft_consensus.cc:515] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.636515 28662 tablet_bootstrap.cc:492] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:17.637946 29228 leader_election.cc:290] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:17.642326 28666 tablet_bootstrap.cc:654] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.642699 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a991fd5fd32408ba8e1065a855b06d3" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:17.644462 28662 tablet_bootstrap.cc:654] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
W20260928 07:56:17.644882 28285 leader_election.cc:343] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:17.646142 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a991fd5fd32408ba8e1065a855b06d3" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:17.651036 28207 raft_consensus.cc:2468] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:17.652385 28286 leader_election.cc:304] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:17.653544 29228 raft_consensus.cc:2804] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:17.654420 29228 raft_consensus.cc:493] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:17.654832 29228 raft_consensus.cc:3060] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:17.658116 28658 ts_tablet_manager.cc:1929] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.658550 28658 log.cc:1199] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/f9c220bb07c945d8a8d8268543414dd6
I20260928 07:56:17.659343 28658 ts_tablet_manager.cc:1950] T f9c220bb07c945d8a8d8268543414dd6 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:17.670256 29228 raft_consensus.cc:515] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.672513 28667 tablet_bootstrap.cc:492] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:17.672932 28667 ts_tablet_manager.cc:1403] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.009s
I20260928 07:56:17.673264 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a991fd5fd32408ba8e1065a855b06d3" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:17.673825 28207 raft_consensus.cc:3060] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:17.675242 28667 raft_consensus.cc:359] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.675845 28667 raft_consensus.cc:385] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.676075 28667 raft_consensus.cc:740] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.677086 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 171) took 1323 ms. Trace:
I20260928 07:56:17.677423 28658 rpcz_store.cc:276] 0928 07:56:16.353765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:16.353913 (+ 148us) service_pool.cc:224] Handling call
0928 07:56:17.228859 (+874946us) ts_tablet_manager.cc:1151] Deleting tablet f9c220bb07c945d8a8d8268543414dd6
0928 07:56:17.228902 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:17.495487 (+266585us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.657964 (+162477us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.661214 (+ 3250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":874237}
I20260928 07:56:17.678194 28666 tablet_bootstrap.cc:492] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:17.678601 28666 ts_tablet_manager.cc:1403] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.149s user 0.009s sys 0.000s
I20260928 07:56:17.678733 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet f9c220bb07c945d8a8d8268543414dd6 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]) successfully deleted
I20260928 07:56:17.680677 28207 raft_consensus.cc:2468] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:17.681146 28667 consensus_queue.cc:260] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.681501 28666 raft_consensus.cc:359] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.682082 28666 raft_consensus.cc:385] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.682329 28666 raft_consensus.cc:740] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.683025 28666 consensus_queue.cc:260] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:17.681810 28286 leader_election.cc:304] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:17.682452 28658 tablet_replica.cc:333] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:17.684453 29084 raft_consensus.cc:2804] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:17.680976 28656 ts_tablet_manager.cc:1929] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:17.685176 28656 log.cc:1199] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/f9854b3eee6746188e47fe1b656130dd
I20260928 07:56:17.684597 28658 raft_consensus.cc:2243] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:17.687651 28656 ts_tablet_manager.cc:1950] T f9854b3eee6746188e47fe1b656130dd P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:17.693601 28658 raft_consensus.cc:2272] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.695310 28662 tablet_bootstrap.cc:492] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:17.695919 28662 ts_tablet_manager.cc:1403] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.060s user 0.009s sys 0.001s
I20260928 07:56:17.696015 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet f9854b3eee6746188e47fe1b656130dd (table default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]) successfully deleted
I20260928 07:56:17.696887 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a991fd5fd32408ba8e1065a855b06d3" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:17.698356 28285 leader_election.cc:343] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:17.698969 29228 leader_election.cc:290] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:17.699582 28658 ts_tablet_manager.cc:1916] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.699147 28656 tablet_replica.cc:333] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:17.706071 28656 raft_consensus.cc:2243] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.706712 28666 ts_tablet_manager.cc:1434] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260928 07:56:17.711387 28656 raft_consensus.cc:2272] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.711880 28662 raft_consensus.cc:359] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.712563 28662 raft_consensus.cc:385] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.702319 27822 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:17.715238 28656 ts_tablet_manager.cc:1916] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.715680 28666 tablet_bootstrap.cc:492] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:17.712808 28662 raft_consensus.cc:740] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.717198 28662 consensus_queue.cc:260] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:17.719151 27822 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 48ed97fd35ee42f3957a18f48fac07bb consensus state has no leader
I20260928 07:56:17.723426 29084 raft_consensus.cc:697] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:17.724314 29084 consensus_queue.cc:237] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.725071 27827 catalog_manager.cc:3541] renamed table default.table_84e7371229d1457d92d342b6b4e36a16 [id=5ede51d78549417b8bfc039f2d7c87f6] in HMS: new name default.table_2519a070e9974faeb26f6bcd4756d344
I20260928 07:56:17.730464 28667 ts_tablet_manager.cc:1434] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.057s user 0.008s sys 0.005s
I20260928 07:56:17.731370 28667 tablet_bootstrap.cc:492] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:17.737944 28662 ts_tablet_manager.cc:1434] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.042s user 0.003s sys 0.003s
I20260928 07:56:17.749396 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet 0099ff638ea34b8c8497f0193e51ad7d from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:17.755371 28666 tablet_bootstrap.cc:654] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.759511 28658 ts_tablet_manager.cc:1929] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.770365 29288 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.221.252:41205 every 8 connection(s)
I20260928 07:56:17.773614 28667 tablet_bootstrap.cc:654] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.777704 28655 rpc_server.cc:307] RPC server started. Bound to: 127.26.221.252:41205
I20260928 07:56:17.782729 28658 log.cc:1199] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/dda49b3ac3104f47bbfc2c780282abca
I20260928 07:56:17.787117 28655 server_base.cc:1193] Dumped server information to /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/master-2/data/info.pb
I20260928 07:56:17.789070 28658 ts_tablet_manager.cc:1950] T dda49b3ac3104f47bbfc2c780282abca P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:17.792176 28656 ts_tablet_manager.cc:1929] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:17.790429 28666 tablet_bootstrap.cc:492] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:17.792892 28666 ts_tablet_manager.cc:1403] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.077s user 0.011s sys 0.000s
I20260928 07:56:17.793605 27511 external_mini_cluster.cc:1434] Started /tmp/dist-test-task47VKlj/build/tsan/bin/kudu as pid 28655
I20260928 07:56:17.795559 28666 raft_consensus.cc:359] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.796137 28666 raft_consensus.cc:385] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.796357 28666 raft_consensus.cc:740] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.799892 28667 tablet_bootstrap.cc:492] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:17.800408 28667 ts_tablet_manager.cc:1403] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.069s user 0.008s sys 0.001s
I20260928 07:56:17.796952 28666 consensus_queue.cc:260] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.803040 28667 raft_consensus.cc:359] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.808097 28667 raft_consensus.cc:385] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.808350 28667 raft_consensus.cc:740] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.808945 28667 consensus_queue.cc:260] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.818164 28666 ts_tablet_manager.cc:1434] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260928 07:56:17.821539 29228 raft_consensus.cc:493] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:17.822021 29228 raft_consensus.cc:515] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.822898 29084 consensus_queue.cc:1048] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:17.824041 29228 leader_election.cc:290] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:17.826020 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed97fd35ee42f3957a18f48fac07bb" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:17.827737 28285 leader_election.cc:343] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:17.833647 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 0099ff638ea34b8c8497f0193e51ad7d
I20260928 07:56:17.834527 28666 tablet_bootstrap.cc:492] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:17.837702 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 173) took 1314 ms. Trace:
I20260928 07:56:17.838357 28658 rpcz_store.cc:276] 0928 07:56:16.522932 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:16.623917 (+100985us) service_pool.cc:224] Handling call
0928 07:56:17.682143 (+1058226us) ts_tablet_manager.cc:1151] Deleting tablet dda49b3ac3104f47bbfc2c780282abca
0928 07:56:17.682203 (+ 60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:17.734057 (+ 51854us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.759384 (+ 25327us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:17.837590 (+ 78206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4880,"tablet-delete.queue_time_us":1056088}
I20260928 07:56:17.840067 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]) successfully deleted
I20260928 07:56:17.840760 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 0099ff638ea34b8c8497f0193e51ad7d with delete_type TABLET_DATA_DELETED (replaced by tablet 11be687831574f5c961f703b03ce2c68) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:17.841117 28658 tablet_replica.cc:333] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:17.841612 29041 tablet_replica.cc:333] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:17.842689 29041 raft_consensus.cc:2243] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.842902 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet 0099ff638ea34b8c8497f0193e51ad7d with delete_type TABLET_DATA_DELETED (replaced by tablet 11be687831574f5c961f703b03ce2c68) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:17.843365 29041 raft_consensus.cc:2272] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.844048 28658 raft_consensus.cc:2243] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.844481 28658 raft_consensus.cc:2272] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.845475 29041 ts_tablet_manager.cc:1916] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.826851 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed97fd35ee42f3957a18f48fac07bb" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:17.846362 28207 raft_consensus.cc:2468] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:17.846583 27822 catalog_manager.cc:6934] ReplaceTablet: tablet 0099ff638ea34b8c8497f0193e51ad7d deleted and replaced by tablet 11be687831574f5c961f703b03ce2c68
I20260928 07:56:17.835484 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 0099ff638ea34b8c8497f0193e51ad7d with delete_type TABLET_DATA_DELETED (replaced by tablet 11be687831574f5c961f703b03ce2c68) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:17.848277 28286 leader_election.cc:304] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:17.853540 29228 raft_consensus.cc:2804] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:17.854080 29228 raft_consensus.cc:493] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:17.854519 29228 raft_consensus.cc:3060] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:17.854782 27822 catalog_manager.cc:5838] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:17.860209 28666 tablet_bootstrap.cc:654] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:17.865564 28658 ts_tablet_manager.cc:1916] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.872268 28667 ts_tablet_manager.cc:1434] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.072s user 0.008s sys 0.000s
I20260928 07:56:17.846364 28656 log.cc:1199] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/3b4dae7924a74f0bbdd5bfb4c34be90e
I20260928 07:56:17.876338 28656 ts_tablet_manager.cc:1950] T 3b4dae7924a74f0bbdd5bfb4c34be90e P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:17.878348 28667 tablet_bootstrap.cc:492] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:17.894614 29243 raft_consensus.cc:493] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:17.898371 29243 raft_consensus.cc:515] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.900358 29243 leader_election.cc:290] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:17.900628 28656 tablet_replica.cc:333] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:17.902829 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 3b4dae7924a74f0bbdd5bfb4c34be90e (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
I20260928 07:56:17.903997 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6fa66d29ca41b0b0d7ad8f30596aab" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:17.905354 28141 leader_election.cc:343] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:17.906518 29284 consensus_queue.cc:1048] T d9cf8015fec54fb7874e93717fc8d38b P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:17.906764 29228 raft_consensus.cc:515] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.909591 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6fa66d29ca41b0b0d7ad8f30596aab" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:17.911296 28142 leader_election.cc:343] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:17.911718 28142 leader_election.cc:304] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:17.913136 29243 raft_consensus.cc:2749] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:17.931612 27828 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e64d9a4cd23460a8b311ced5acf4170 from {username='slave'} at 127.0.0.1:51542
W20260928 07:56:17.938150 28434 consensus_peers.cc:597] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b4dae7924a74f0bbdd5bfb4c34be90e. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:17.941531 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 11be687831574f5c961f703b03ce2c68 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.942600 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11be687831574f5c961f703b03ce2c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.944507 28666 tablet_bootstrap.cc:492] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:17.944921 28666 ts_tablet_manager.cc:1403] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.111s user 0.009s sys 0.001s
I20260928 07:56:17.947630 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 11be687831574f5c961f703b03ce2c68 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.948624 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11be687831574f5c961f703b03ce2c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.951444 28666 raft_consensus.cc:359] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.952924 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 11be687831574f5c961f703b03ce2c68 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:17.953936 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11be687831574f5c961f703b03ce2c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:17.982261 28656 raft_consensus.cc:2243] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:17.982906 28656 raft_consensus.cc:2272] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:17.984694 29296 sys_catalog.cc:263] Verifying existing consensus state
I20260928 07:56:17.984859 28656 ts_tablet_manager.cc:1916] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:17.988029 29228 leader_election.cc:290] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:17.988955 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed97fd35ee42f3957a18f48fac07bb" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:17.990442 28285 leader_election.cc:343] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:17.991611 28666 raft_consensus.cc:385] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:17.991973 28666 raft_consensus.cc:740] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:17.992736 28666 consensus_queue.cc:260] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:17.999859 28667 tablet_bootstrap.cc:654] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.004433 29041 ts_tablet_manager.cc:1929] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:18.005863 27828 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 8e64d9a4cd23460a8b311ced5acf4170
I20260928 07:56:18.006774 28544 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:56:17.987540 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ed97fd35ee42f3957a18f48fac07bb" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:18.013613 28204 raft_consensus.cc:3060] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.014591 28666 ts_tablet_manager.cc:1434] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.069s user 0.004s sys 0.004s
I20260928 07:56:18.021777 28666 tablet_bootstrap.cc:492] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:18.010363 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e64d9a4cd23460a8b311ced5acf4170 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e70055265684586972191331e0dd5cd) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:18.029578 28204 raft_consensus.cc:2468] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
W20260928 07:56:18.030596 28434 consensus_peers.cc:597] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e -> Peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Couldn't send request to peer 3bd67de620c94af3b7c8e3ba7d42f980. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:18.030646 28286 leader_election.cc:304] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:18.031378 29228 raft_consensus.cc:2804] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:18.032539 29228 raft_consensus.cc:697] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:18.033427 29228 consensus_queue.cc:237] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.037756 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e64d9a4cd23460a8b311ced5acf4170 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e70055265684586972191331e0dd5cd) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:18.039027 27816 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 48ed97fd35ee42f3957a18f48fac07bb consensus state has no leader
I20260928 07:56:18.039496 28397 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:56:18.047255 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e64d9a4cd23460a8b311ced5acf4170 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e70055265684586972191331e0dd5cd) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:18.048123 28662 tablet_bootstrap.cc:492] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:18.004858 29041 log.cc:1199] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/0099ff638ea34b8c8497f0193e51ad7d
I20260928 07:56:18.055408 29243 raft_consensus.cc:493] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:18.055771 29041 ts_tablet_manager.cc:1950] T 0099ff638ea34b8c8497f0193e51ad7d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:18.055893 29243 raft_consensus.cc:515] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.056968 28662 tablet_bootstrap.cc:654] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.057310 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:18.058162 28666 tablet_bootstrap.cc:654] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.058254 29243 leader_election.cc:290] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:18.058382 29041 tablet_replica.cc:333] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:18.059171 29041 raft_consensus.cc:2243] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:18.059721 29041 raft_consensus.cc:2272] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.060176 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711949ab6f4548d09e06b849202d2d90" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:18.060837 28350 raft_consensus.cc:2468] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:18.062225 28142 leader_election.cc:304] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:18.061892 29296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Bootstrap starting.
I20260928 07:56:18.063587 27828 catalog_manager.cc:6934] ReplaceTablet: tablet 8e64d9a4cd23460a8b311ced5acf4170 deleted and replaced by tablet 3e70055265684586972191331e0dd5cd
I20260928 07:56:18.064320 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711949ab6f4548d09e06b849202d2d90" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:18.066087 28141 leader_election.cc:343] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:18.066769 29243 raft_consensus.cc:2804] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:18.067106 29243 raft_consensus.cc:493] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:18.067390 29243 raft_consensus.cc:3060] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.072566 27822 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:18.075011 27823 catalog_manager.cc:2213] created HMS catalog entry for table [id=dc06a80441584734993d844845f8bdcc]
I20260928 07:56:18.076854 29041 ts_tablet_manager.cc:1916] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:18.078689 28662 tablet_bootstrap.cc:492] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:18.080204 28662 ts_tablet_manager.cc:1403] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.003s
I20260928 07:56:18.087376 28662 raft_consensus.cc:359] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.088176 28662 raft_consensus.cc:385] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.088469 28662 raft_consensus.cc:740] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.089159 28662 consensus_queue.cc:260] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.094287 27828 master_service.cc:960] ReplaceTablet: received request to replace tablet f7489fefeac8420f973245e1b1bb2d6d from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:18.108268 28656 ts_tablet_manager.cc:1929] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:18.116696 28666 tablet_bootstrap.cc:492] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:18.117106 28666 ts_tablet_manager.cc:1403] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.095s user 0.010s sys 0.000s
I20260928 07:56:18.119877 27823 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 121) took 3489 ms. Trace:
I20260928 07:56:18.119679 28666 raft_consensus.cc:359] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.120359 28666 raft_consensus.cc:385] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.120637 28666 raft_consensus.cc:740] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.120213 27823 rpcz_store.cc:276] 0928 07:56:14.630864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:14.856731 (+225867us) service_pool.cc:224] Handling call
0928 07:56:17.217864 (+2361133us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:17.219907 (+ 2043us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:18.074958 (+855051us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:18.119156 (+ 44198us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:18.119513 (+ 357us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:18.119810 (+ 297us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:18.077061 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:18.077665 (+ 604us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:18.077706 (+ 41us) write_op.cc:435] Acquired schema lock
0928 07:56:18.077728 (+ 22us) tablet.cc:662] Decoding operations
0928 07:56:18.078052 (+ 324us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:18.078092 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:18.078115 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:18.078303 (+ 188us) tablet.cc:701] Row locks acquired
0928 07:56:18.078316 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:18.078423 (+ 107us) write_op.cc:270] Start()
0928 07:56:18.078502 (+ 79us) write_op.cc:276] Timestamp: P: 1790582178078369 usec, L: 0
0928 07:56:18.078517 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:18.078985 (+ 468us) log.cc:844] Serialized 433 byte log entry
0928 07:56:18.116722 (+ 37737us) op_driver.cc:464] REPLICATION: finished
0928 07:56:18.117096 (+ 374us) write_op.cc:301] APPLY: starting
0928 07:56:18.117174 (+ 78us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:18.117312 (+ 138us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:18.117420 (+ 108us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:18.117855 (+ 435us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:18.118015 (+ 160us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:18.118056 (+ 41us) write_op.cc:312] APPLY: finished
0928 07:56:18.118273 (+ 217us) log.cc:844] Serialized 29 byte log entry
0928 07:56:18.118433 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:18.118508 (+ 75us) write_op.cc:454] Released schema lock
0928 07:56:18.118546 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:18.118776 (+ 230us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:18.118801 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":504246,"Hive Metastore.run_cpu_time_us":612,"Hive Metastore.run_wall_time_us":350210,"spinlock_wait_cycles":21504,"child_traces":[["op",{"apply.queue_time_us":222,"apply.run_cpu_time_us":1646,"apply.run_wall_time_us":1646,"num_ops":2,"prepare.queue_time_us":187,"prepare.run_cpu_time_us":2248,"prepare.run_wall_time_us":2247,"raft.queue_time_us":18364,"raft.run_cpu_time_us":987,"raft.run_wall_time_us":987,"replication_time_us":38089}]]}
I20260928 07:56:18.130198 28658 ts_tablet_manager.cc:1929] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:18.130614 28658 log.cc:1199] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/f9854b3eee6746188e47fe1b656130dd
I20260928 07:56:18.131318 28658 ts_tablet_manager.cc:1950] T f9854b3eee6746188e47fe1b656130dd P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:18.137941 28656 log.cc:1199] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/4bc16584c61c4ebea9bdf4772630ef58
I20260928 07:56:18.138070 28666 consensus_queue.cc:260] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.139374 28656 ts_tablet_manager.cc:1950] T 4bc16584c61c4ebea9bdf4772630ef58 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:18.140018 28667 tablet_bootstrap.cc:492] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:18.141099 28667 ts_tablet_manager.cc:1403] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.263s user 0.015s sys 0.004s
I20260928 07:56:18.143693 28667 raft_consensus.cc:359] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.139846 28662 ts_tablet_manager.cc:1434] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.059s user 0.006s sys 0.000s
I20260928 07:56:18.144351 28667 raft_consensus.cc:385] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.144605 28667 raft_consensus.cc:740] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.145346 28667 consensus_queue.cc:260] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.147575 28667 ts_tablet_manager.cc:1434] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260928 07:56:18.126166 29243 raft_consensus.cc:515] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.150527 29243 leader_election.cc:290] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:18.153074 28656 tablet_replica.cc:333] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:18.157349 28656 raft_consensus.cc:2243] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:18.163898 28666 ts_tablet_manager.cc:1434] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.046s user 0.002s sys 0.003s
I20260928 07:56:18.173827 29257 raft_consensus.cc:493] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:18.174341 29257 raft_consensus.cc:515] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.148432 28667 tablet_bootstrap.cc:492] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:18.176288 29257 leader_election.cc:290] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:18.178014 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 175) took 1238 ms. Trace:
I20260928 07:56:18.178332 28658 rpcz_store.cc:276] 0928 07:56:16.939702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:16.939846 (+ 144us) service_pool.cc:224] Handling call
0928 07:56:17.840932 (+901086us) ts_tablet_manager.cc:1151] Deleting tablet f9854b3eee6746188e47fe1b656130dd
0928 07:56:17.840985 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:17.954354 (+113369us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:18.130043 (+175689us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:18.177952 (+ 47909us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":900507}
I20260928 07:56:18.179694 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet f9854b3eee6746188e47fe1b656130dd (table default.table_995804006b294eb8a427e904cad03079 [id=58206f61fd6944d390df969d8d038e71]) successfully deleted
I20260928 07:56:18.181032 28656 raft_consensus.cc:2272] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.183089 28656 ts_tablet_manager.cc:1916] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:18.158253 28253 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
W20260928 07:56:18.160895 28141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 55040.9us
I20260928 07:56:18.189116 27820 catalog_manager.cc:2213] created HMS catalog entry for table [id=36f9b53b9add43e598bd6cd38e694c02]
I20260928 07:56:18.190601 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 4bc16584c61c4ebea9bdf4772630ef58 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
I20260928 07:56:18.191136 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711949ab6f4548d09e06b849202d2d90" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:18.125787 28142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 63639.6us
I20260928 07:56:18.178587 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a991fd5fd32408ba8e1065a855b06d3" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:18.191864 28499 raft_consensus.cc:3060] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.192247 28204 raft_consensus.cc:2393] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in this term.
I20260928 07:56:18.194721 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a991fd5fd32408ba8e1065a855b06d3" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:18.196477 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711949ab6f4548d09e06b849202d2d90" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:18.196985 28350 raft_consensus.cc:3060] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.204578 29041 ts_tablet_manager.cc:1929] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:18.205035 29041 log.cc:1199] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/8e64d9a4cd23460a8b311ced5acf4170
I20260928 07:56:18.205909 29041 ts_tablet_manager.cc:1950] T 8e64d9a4cd23460a8b311ced5acf4170 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:18.208665 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 8e64d9a4cd23460a8b311ced5acf4170 (table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]) successfully deleted
I20260928 07:56:18.211562 28350 raft_consensus.cc:2468] T 711949ab6f4548d09e06b849202d2d90 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:18.214208 28434 leader_election.cc:304] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:18.215010 29257 raft_consensus.cc:3060] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:18.215500 28434 consensus_peers.cc:597] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e -> Peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Couldn't send request to peer 3bd67de620c94af3b7c8e3ba7d42f980. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:18.225988 28142 leader_election.cc:304] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:18.227464 27820 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 122) took 3299 ms. Trace:
I20260928 07:56:18.228628 29303 raft_consensus.cc:2804] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:18.229882 29303 raft_consensus.cc:697] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:18.230871 29303 consensus_queue.cc:237] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.236040 28656 ts_tablet_manager.cc:1929] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:18.236457 28656 log.cc:1199] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/0099ff638ea34b8c8497f0193e51ad7d
I20260928 07:56:18.237277 28656 ts_tablet_manager.cc:1950] T 0099ff638ea34b8c8497f0193e51ad7d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:18.238551 28666 tablet_bootstrap.cc:492] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:18.227844 27820 rpcz_store.cc:276] 0928 07:56:14.928302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:14.928467 (+ 165us) service_pool.cc:224] Handling call
0928 07:56:17.215055 (+2286588us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:17.221163 (+ 6108us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:18.189069 (+967906us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:18.226816 (+ 37747us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:18.227112 (+ 296us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:18.227399 (+ 287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:18.201421 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:18.201821 (+ 400us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:18.201992 (+ 171us) write_op.cc:435] Acquired schema lock
0928 07:56:18.202007 (+ 15us) tablet.cc:662] Decoding operations
0928 07:56:18.202350 (+ 343us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:18.202393 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:18.202418 (+ 25us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:18.202671 (+ 253us) tablet.cc:701] Row locks acquired
0928 07:56:18.202686 (+ 15us) write_op.cc:260] PREPARE: finished
0928 07:56:18.202830 (+ 144us) write_op.cc:270] Start()
0928 07:56:18.202924 (+ 94us) write_op.cc:276] Timestamp: P: 1790582178202754 usec, L: 0
0928 07:56:18.202940 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 07:56:18.203530 (+ 590us) log.cc:844] Serialized 433 byte log entry
0928 07:56:18.220479 (+ 16949us) op_driver.cc:464] REPLICATION: finished
0928 07:56:18.223132 (+ 2653us) write_op.cc:301] APPLY: starting
0928 07:56:18.223190 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:18.223304 (+ 114us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:18.223399 (+ 95us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:18.223819 (+ 420us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:18.223958 (+ 139us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:18.224004 (+ 46us) write_op.cc:312] APPLY: finished
0928 07:56:18.224187 (+ 183us) log.cc:844] Serialized 29 byte log entry
0928 07:56:18.224356 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:18.224427 (+ 71us) write_op.cc:454] Released schema lock
0928 07:56:18.224458 (+ 31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":888870,"Hive Metastore.run_cpu_time_us":735,"Hive Metastore.run_wall_time_us":77751,"spinlock_wait_cycles":31616,"child_traces":[["op",{"apply.queue_time_us":2519,"apply.run_cpu_time_us":1516,"apply.run_wall_time_us":1516,"num_ops":2,"prepare.queue_time_us":10561,"prepare.run_cpu_time_us":2469,"prepare.run_wall_time_us":11064,"raft.queue_time_us":1164,"raft.run_cpu_time_us":14,"raft.run_wall_time_us":14,"replication_time_us":17464,"threads_started":1}]]}
I20260928 07:56:18.244313 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:18.247650 28656 tablet_replica.cc:333] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:18.254019 28656 raft_consensus.cc:2243] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:18.254568 28656 raft_consensus.cc:2272] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.257112 28656 ts_tablet_manager.cc:1916] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:18.269153 29257 raft_consensus.cc:2749] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:18.279076 29307 raft_consensus.cc:493] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:18.279721 29307 raft_consensus.cc:515] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:18.283121 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7489fefeac8420f973245e1b1bb2d6d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:18.257083 28499 raft_consensus.cc:2468] T 711949ab6f4548d09e06b849202d2d90 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
W20260928 07:56:18.284922 28141 leader_election.cc:343] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:18.288081 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7489fefeac8420f973245e1b1bb2d6d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:18.288892 28350 raft_consensus.cc:2468] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:18.297356 29307 leader_election.cc:290] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:18.298070 29228 consensus_queue.cc:1048] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:18.299248 28142 leader_election.cc:304] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:18.300228 29243 raft_consensus.cc:2804] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:18.300591 29243 raft_consensus.cc:493] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:18.301079 29243 raft_consensus.cc:3060] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.306555 27828 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet f7489fefeac8420f973245e1b1bb2d6d
I20260928 07:56:18.308849 29243 raft_consensus.cc:515] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:18.311789 28658 tablet_replica.cc:333] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:18.312299 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet f7489fefeac8420f973245e1b1bb2d6d with delete_type TABLET_DATA_DELETED (replaced by tablet b801232a1a4f4b0a80974fc838a3b6f5) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:18.316747 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet f7489fefeac8420f973245e1b1bb2d6d with delete_type TABLET_DATA_DELETED (replaced by tablet b801232a1a4f4b0a80974fc838a3b6f5) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:18.318531 29041 tablet_replica.cc:333] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:18.319382 29041 raft_consensus.cc:2243] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:18.319854 29041 raft_consensus.cc:2272] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.321195 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7489fefeac8420f973245e1b1bb2d6d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:18.321852 29041 ts_tablet_manager.cc:1916] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 07:56:18.322916 28142 leader_election.cc:343] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:18.323571 29243 leader_election.cc:290] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:18.328478 28656 ts_tablet_manager.cc:1929] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:18.333442 28656 log.cc:1199] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/8e64d9a4cd23460a8b311ced5acf4170
I20260928 07:56:18.334441 28656 ts_tablet_manager.cc:1950] T 8e64d9a4cd23460a8b311ced5acf4170 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:18.336097 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 8e64d9a4cd23460a8b311ced5acf4170 (table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]) successfully deleted
I20260928 07:56:18.338460 29296 log.cc:826] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Log is configured to *not* fsync() on all Append() calls
I20260928 07:56:18.313750 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7489fefeac8420f973245e1b1bb2d6d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:18.314345 28666 tablet_bootstrap.cc:654] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.349689 28656 tablet_replica.cc:333] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:18.350555 28656 raft_consensus.cc:2243] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:18.351063 28656 raft_consensus.cc:2272] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.352993 28656 ts_tablet_manager.cc:1916] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:18.354610 27828 catalog_manager.cc:6934] ReplaceTablet: tablet f7489fefeac8420f973245e1b1bb2d6d deleted and replaced by tablet b801232a1a4f4b0a80974fc838a3b6f5
I20260928 07:56:18.356196 27828 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_b86c301602f645dda93f94e00e31e9fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:18.365788 28667 tablet_bootstrap.cc:654] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.342002 28498 raft_consensus.cc:3060] T 42897682db564e56b8e6bf8b75f8641c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:18.348533 28434 consensus_peers.cc:597] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e -> Peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Couldn't send request to peer 3bd67de620c94af3b7c8e3ba7d42f980. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b4dae7924a74f0bbdd5bfb4c34be90e. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:18.352841 28478 tablet_service.cc:1558] Processing DeleteTablet for tablet f7489fefeac8420f973245e1b1bb2d6d with delete_type TABLET_DATA_DELETED (replaced by tablet b801232a1a4f4b0a80974fc838a3b6f5) from {username='slave'} at 127.0.0.1:50372
W20260928 07:56:18.375373 28141 leader_election.cc:343] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:18.375820 28141 leader_election.cc:304] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
W20260928 07:56:18.376384 28141 raft_consensus.cc:2686] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 07:56:18.377122 27824 catalog_manager.cc:2213] created HMS catalog entry for table [id=0485a22c767b4bcf9cf4424064408d18]
I20260928 07:56:18.393913 28666 tablet_bootstrap.cc:492] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:18.394423 28666 ts_tablet_manager.cc:1403] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.156s user 0.006s sys 0.010s
I20260928 07:56:18.394927 28656 ts_tablet_manager.cc:1929] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:18.395392 28656 log.cc:1199] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/f7489fefeac8420f973245e1b1bb2d6d
I20260928 07:56:18.396070 28656 ts_tablet_manager.cc:1950] T f7489fefeac8420f973245e1b1bb2d6d P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:18.397737 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet f7489fefeac8420f973245e1b1bb2d6d (table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]) successfully deleted
I20260928 07:56:18.398928 28666 raft_consensus.cc:359] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:18.399672 28666 raft_consensus.cc:385] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.399957 28666 raft_consensus.cc:740] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.400673 29084 consensus_queue.cc:1048] T 42897682db564e56b8e6bf8b75f8641c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:18.339363 28658 raft_consensus.cc:2243] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:18.406462 28658 raft_consensus.cc:2272] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.409116 28658 ts_tablet_manager.cc:1916] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:18.443293 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 3e70055265684586972191331e0dd5cd (DEFAULT_TABLE table=default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.444486 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e70055265684586972191331e0dd5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.418100 28544 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:56:18.446933 27823 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e64d9a4cd23460a8b311ced5acf4170 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:18.400625 28666 consensus_queue.cc:260] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:18.452031 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 3e70055265684586972191331e0dd5cd (DEFAULT_TABLE table=default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.453264 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e70055265684586972191331e0dd5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.453378 27823 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_39d378a820034bbbbd5505707a436c63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:18.458340 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 3e70055265684586972191331e0dd5cd (DEFAULT_TABLE table=default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.459517 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e70055265684586972191331e0dd5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.461993 27824 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 127) took 2383 ms. Trace:
I20260928 07:56:18.462358 27824 rpcz_store.cc:276] 0928 07:56:16.078175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:16.078332 (+ 157us) service_pool.cc:224] Handling call
0928 07:56:17.223141 (+1144809us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:17.224649 (+ 1508us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:18.377066 (+1152417us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:18.460862 (+ 83796us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:18.461178 (+ 316us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:18.461927 (+ 749us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:18.386533 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:18.386941 (+ 408us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:18.386965 (+ 24us) write_op.cc:435] Acquired schema lock
0928 07:56:18.386977 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:18.387232 (+ 255us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:18.387268 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:18.387291 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:18.387488 (+ 197us) tablet.cc:701] Row locks acquired
0928 07:56:18.387501 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:18.387611 (+ 110us) write_op.cc:270] Start()
0928 07:56:18.387693 (+ 82us) write_op.cc:276] Timestamp: P: 1790582178387525 usec, L: 0
0928 07:56:18.387708 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:18.388294 (+ 586us) log.cc:844] Serialized 433 byte log entry
0928 07:56:18.454741 (+ 66447us) op_driver.cc:464] REPLICATION: finished
0928 07:56:18.459001 (+ 4260us) write_op.cc:301] APPLY: starting
0928 07:56:18.459063 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:18.459201 (+ 138us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:18.459311 (+ 110us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:18.459780 (+ 469us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:18.459973 (+ 193us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:18.460020 (+ 47us) write_op.cc:312] APPLY: finished
0928 07:56:18.460228 (+ 208us) log.cc:844] Serialized 29 byte log entry
0928 07:56:18.460408 (+ 180us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:18.460482 (+ 74us) write_op.cc:454] Released schema lock
0928 07:56:18.460521 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:18.461440 (+ 919us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:18.461467 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":963303,"Hive Metastore.run_cpu_time_us":711,"Hive Metastore.run_wall_time_us":185845,"child_traces":[["op",{"apply.queue_time_us":4087,"apply.run_cpu_time_us":1768,"apply.run_wall_time_us":2401,"num_ops":2,"prepare.queue_time_us":7807,"prepare.run_cpu_time_us":2120,"prepare.run_wall_time_us":3563,"replication_time_us":66933}]]}
I20260928 07:56:18.477378 28662 tablet_bootstrap.cc:492] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:18.483614 28662 tablet_bootstrap.cc:654] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.493301 28667 tablet_bootstrap.cc:492] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:18.493816 28667 ts_tablet_manager.cc:1403] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.346s user 0.011s sys 0.000s
I20260928 07:56:18.504793 28662 tablet_bootstrap.cc:492] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:18.505275 28662 ts_tablet_manager.cc:1403] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.028s user 0.013s sys 0.000s
I20260928 07:56:18.505491 28666 ts_tablet_manager.cc:1434] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.057s user 0.007s sys 0.000s
I20260928 07:56:18.507354 29041 ts_tablet_manager.cc:1929] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:18.507762 29041 log.cc:1199] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/f7489fefeac8420f973245e1b1bb2d6d
I20260928 07:56:18.508457 29041 ts_tablet_manager.cc:1950] T f7489fefeac8420f973245e1b1bb2d6d P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:18.507881 28662 raft_consensus.cc:359] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.508770 28662 raft_consensus.cc:385] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.509039 28662 raft_consensus.cc:740] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.509856 28662 consensus_queue.cc:260] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.520462 28662 ts_tablet_manager.cc:1434] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260928 07:56:18.537961 28666 tablet_bootstrap.cc:492] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:18.560068 27820 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
W20260928 07:56:18.562072 27820 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 11be687831574f5c961f703b03ce2c68 consensus state has no leader
I20260928 07:56:18.564563 27822 catalog_manager.cc:5838] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:18.565840 27822 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:18.569259 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet f7489fefeac8420f973245e1b1bb2d6d (table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]) successfully deleted
I20260928 07:56:18.569684 28667 raft_consensus.cc:359] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.570329 28667 raft_consensus.cc:385] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.570585 28667 raft_consensus.cc:740] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.571208 28667 consensus_queue.cc:260] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:18.579300 27826 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_dacc6ff6b7fa48c78a6b028734185c0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:18.581425 27829 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 115) took 4695 ms. Trace:
I20260928 07:56:18.582005 28666 tablet_bootstrap.cc:654] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.581763 27829 rpcz_store.cc:276] 0928 07:56:13.886518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:13.887393 (+ 875us) service_pool.cc:224] Handling call
0928 07:56:16.355556 (+2468163us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:18.581354 (+2225798us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":996,"Hive Metastore.run_cpu_time_us":480,"Hive Metastore.run_wall_time_us":223495}
W20260928 07:56:18.586560 27823 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_39d378a820034bbbbd5505707a436c63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:18.586938 27827 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 117) took 4699 ms. Trace:
I20260928 07:56:18.587296 27827 rpcz_store.cc:276] 0928 07:56:13.887502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:13.906908 (+ 19406us) service_pool.cc:224] Handling call
0928 07:56:17.211900 (+3304992us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:18.584895 (+1372995us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:18.585912 (+ 1017us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:18.586866 (+ 954us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":194,"Hive Metastore.run_cpu_time_us":1809,"Hive Metastore.run_wall_time_us":511413}
W20260928 07:56:18.589485 27828 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b86c301602f645dda93f94e00e31e9fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:18.583050 27825 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 116) took 4696 ms. Trace:
I20260928 07:56:18.592654 27825 rpcz_store.cc:276] 0928 07:56:13.886783 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:13.889275 (+ 2492us) service_pool.cc:224] Handling call
0928 07:56:16.356638 (+2467363us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:18.582995 (+2226357us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":206301,"Hive Metastore.run_cpu_time_us":340,"Hive Metastore.run_wall_time_us":207738}
W20260928 07:56:18.608217 28434 consensus_peers.cc:597] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e64d9a4cd23460a8b311ced5acf4170. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:18.573148 28667 ts_tablet_manager.cc:1434] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.078s user 0.002s sys 0.000s
I20260928 07:56:18.610281 28667 tablet_bootstrap.cc:492] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:18.615250 27824 catalog_manager.cc:5838] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:18.622429 27820 master_service.cc:960] ReplaceTablet: received request to replace tablet be116490ca57460688eaa2ff1c0415de from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:18.627656 28666 tablet_bootstrap.cc:492] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:18.628114 28666 ts_tablet_manager.cc:1403] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.090s user 0.007s sys 0.001s
I20260928 07:56:18.632448 28331 tablet_service.cc:1511] Processing CreateTablet for tablet d139c0b8379446dfba037e96e0501a0b (DEFAULT_TABLE table=default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.633473 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d139c0b8379446dfba037e96e0501a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.641625 28658 ts_tablet_manager.cc:1929] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:18.642035 28658 log.cc:1199] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/3b4dae7924a74f0bbdd5bfb4c34be90e
I20260928 07:56:18.642776 28658 ts_tablet_manager.cc:1950] T 3b4dae7924a74f0bbdd5bfb4c34be90e P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:18.630750 28666 raft_consensus.cc:359] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.647406 28667 tablet_bootstrap.cc:654] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.648393 28478 tablet_service.cc:1511] Processing CreateTablet for tablet d139c0b8379446dfba037e96e0501a0b (DEFAULT_TABLE table=default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.649945 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d139c0b8379446dfba037e96e0501a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.653352 28666 raft_consensus.cc:385] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.653906 28666 raft_consensus.cc:740] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.655200 28666 consensus_queue.cc:260] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.659000 29084 raft_consensus.cc:493] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:18.659494 29084 raft_consensus.cc:515] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:18.661588 29296 log.cc:927] Time spent T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Append to log took a long time: real 0.111s user 0.001s sys 0.000s
I20260928 07:56:18.661515 29084 leader_election.cc:290] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:18.665196 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6fa66d29ca41b0b0d7ad8f30596aab" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:18.667200 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6fa66d29ca41b0b0d7ad8f30596aab" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:18.667436 28285 leader_election.cc:343] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:18.667783 28207 raft_consensus.cc:2468] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:18.669528 28286 leader_election.cc:304] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:18.670701 29084 raft_consensus.cc:2804] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:18.671056 29084 raft_consensus.cc:493] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:18.671373 29084 raft_consensus.cc:3060] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.672055 27822 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:18.673502 29257 raft_consensus.cc:493] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:18.671383 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 177) took 1459 ms. Trace:
I20260928 07:56:18.673935 29257 raft_consensus.cc:515] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.675935 29257 leader_election.cc:290] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:18.677037 27829 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_cc618d40e945497e85e73c63ae4b6bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:18.678486 29084 raft_consensus.cc:515] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.674695 28658 rpcz_store.cc:276] 0928 07:56:17.212173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:17.212385 (+ 212us) service_pool.cc:224] Handling call
0928 07:56:18.311593 (+1099208us) ts_tablet_manager.cc:1151] Deleting tablet 3b4dae7924a74f0bbdd5bfb4c34be90e
0928 07:56:18.311644 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:18.559614 (+247970us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:18.641489 (+ 81875us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:18.671083 (+ 29594us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15714,"tablet-delete.queue_time_us":1098571}
I20260928 07:56:18.679780 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 3b4dae7924a74f0bbdd5bfb4c34be90e (table default.table_457d1f751e7c405eb8466e6f18c185ac [id=b306197c3c4c4a29a0bf677a8f8b54b9]) successfully deleted
I20260928 07:56:18.680785 28666 ts_tablet_manager.cc:1434] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.052s user 0.008s sys 0.001s
W20260928 07:56:18.681200 28434 leader_election.cc:343] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 4bc16584c61c4ebea9bdf4772630ef58
I20260928 07:56:18.681612 28666 tablet_bootstrap.cc:492] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
W20260928 07:56:18.681869 28434 leader_election.cc:343] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 4bc16584c61c4ebea9bdf4772630ef58
I20260928 07:56:18.682220 28434 leader_election.cc:304] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:18.683466 29257 raft_consensus.cc:2749] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:18.685956 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6fa66d29ca41b0b0d7ad8f30596aab" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:18.686234 29084 leader_election.cc:290] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
W20260928 07:56:18.687188 28285 leader_election.cc:343] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:18.687490 29296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 07:56:18.691586 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6fa66d29ca41b0b0d7ad8f30596aab" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:18.692101 28207 raft_consensus.cc:3060] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.700016 28658 tablet_replica.cc:333] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:18.700917 28658 raft_consensus.cc:2243] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:18.701637 28658 raft_consensus.cc:2272] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.704239 27822 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:18.705834 28187 tablet_service.cc:1511] Processing CreateTablet for tablet d139c0b8379446dfba037e96e0501a0b (DEFAULT_TABLE table=default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.706879 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d139c0b8379446dfba037e96e0501a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.707096 28207 raft_consensus.cc:2468] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:18.709410 28329 tablet_service.cc:1511] Processing CreateTablet for tablet b801232a1a4f4b0a80974fc838a3b6f5 (DEFAULT_TABLE table=default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.710453 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b801232a1a4f4b0a80974fc838a3b6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.710296 28184 tablet_service.cc:1511] Processing CreateTablet for tablet b801232a1a4f4b0a80974fc838a3b6f5 (DEFAULT_TABLE table=default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.711264 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b801232a1a4f4b0a80974fc838a3b6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.714130 28327 tablet_service.cc:1511] Processing CreateTablet for tablet 41352cf9a4974e2b861d2234d9a5accd (DEFAULT_TABLE table=default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.715276 28327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41352cf9a4974e2b861d2234d9a5accd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.719095 28479 tablet_service.cc:1511] Processing CreateTablet for tablet b801232a1a4f4b0a80974fc838a3b6f5 (DEFAULT_TABLE table=default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.721545 28658 ts_tablet_manager.cc:1916] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:18.723305 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b801232a1a4f4b0a80974fc838a3b6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.726904 28667 tablet_bootstrap.cc:492] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:18.727330 28667 ts_tablet_manager.cc:1403] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.117s user 0.010s sys 0.000s
I20260928 07:56:18.729729 28667 raft_consensus.cc:359] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.730309 28286 leader_election.cc:304] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:18.731904 29283 consensus_queue.cc:1048] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:18.732491 28667 raft_consensus.cc:385] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.732770 28667 raft_consensus.cc:740] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.733145 29283 raft_consensus.cc:2804] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:18.733620 29283 raft_consensus.cc:697] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:18.734359 29283 consensus_queue.cc:237] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.735744 28666 tablet_bootstrap.cc:654] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.740711 28667 consensus_queue.cc:260] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.745087 28667 ts_tablet_manager.cc:1434] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
W20260928 07:56:18.752010 28434 consensus_peers.cc:597] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0099ff638ea34b8c8497f0193e51ad7d. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:18.755232 27822 master_service.cc:960] ReplaceTablet: received request to replace tablet d554c2be0f2a436ab5a0a62adcadbdd3 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:18.756618 29296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Bootstrap complete.
I20260928 07:56:18.774438 27820 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet be116490ca57460688eaa2ff1c0415de
I20260928 07:56:18.775419 28667 tablet_bootstrap.cc:492] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:18.775949 27820 catalog_manager.cc:6934] ReplaceTablet: tablet be116490ca57460688eaa2ff1c0415de deleted and replaced by tablet 9eaff4ec62804f00a750d1d31f44366d
I20260928 07:56:18.776600 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet be116490ca57460688eaa2ff1c0415de with delete_type TABLET_DATA_DELETED (replaced by tablet 9eaff4ec62804f00a750d1d31f44366d) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:18.777307 29041 tablet_replica.cc:333] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:18.778072 29041 raft_consensus.cc:2243] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:18.778168 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet be116490ca57460688eaa2ff1c0415de with delete_type TABLET_DATA_DELETED (replaced by tablet 9eaff4ec62804f00a750d1d31f44366d) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:18.778579 29041 raft_consensus.cc:2272] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.781013 29041 ts_tablet_manager.cc:1916] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:18.784343 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet be116490ca57460688eaa2ff1c0415de with delete_type TABLET_DATA_DELETED (replaced by tablet 9eaff4ec62804f00a750d1d31f44366d) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:18.785076 28656 tablet_replica.cc:333] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:18.787563 27825 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:18.789480 28656 raft_consensus.cc:2243] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:18.790015 28656 raft_consensus.cc:2272] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:18.792440 28656 ts_tablet_manager.cc:1916] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:18.792680 27820 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_cf58487e79464a79a31128dfc7c26d09" } modify_external_catalogs: true
I20260928 07:56:18.793399 27820 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_cf58487e79464a79a31128dfc7c26d09" } modify_external_catalogs: true
I20260928 07:56:18.795032 27825 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_c8c37153157644cba24992442f231936" } new_table_name: "default.Table_1f78a84fc89e458e8b34bcaa23bdc72d" modify_external_catalogs: true
I20260928 07:56:18.768725 29328 tablet.cc:1751] T bbeec0005d4144a2a3b888b7dbcb5087 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:18.805749 28662 tablet_bootstrap.cc:492] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:18.810200 29330 tablet.cc:1751] T bbeec0005d4144a2a3b888b7dbcb5087 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:18.812697 28662 tablet_bootstrap.cc:654] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.818466 28667 tablet_bootstrap.cc:654] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:18.826097 27822 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet d554c2be0f2a436ab5a0a62adcadbdd3
I20260928 07:56:18.828404 28330 tablet_service.cc:1558] Processing DeleteTablet for tablet d554c2be0f2a436ab5a0a62adcadbdd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e15ae22ba5d46c09b1cc9d99dce8b38) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:18.837431 29284 consensus_queue.cc:1048] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:18.847163 29336 tablet.cc:1751] T bbeec0005d4144a2a3b888b7dbcb5087 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:18.849924 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet d554c2be0f2a436ab5a0a62adcadbdd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e15ae22ba5d46c09b1cc9d99dce8b38) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:18.859283 28207 raft_consensus.cc:1275] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Refusing update from remote peer 3bd67de620c94af3b7c8e3ba7d42f980: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:18.861898 28498 raft_consensus.cc:3060] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.862866 29084 consensus_queue.cc:1048] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:18.868546 29312 raft_consensus.cc:493] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:18.869026 29312 raft_consensus.cc:515] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:18.869767 28666 tablet_bootstrap.cc:492] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:18.869834 27822 catalog_manager.cc:6934] ReplaceTablet: tablet d554c2be0f2a436ab5a0a62adcadbdd3 deleted and replaced by tablet 3e15ae22ba5d46c09b1cc9d99dce8b38
I20260928 07:56:18.870175 28666 ts_tablet_manager.cc:1403] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.189s user 0.003s sys 0.011s
I20260928 07:56:18.871269 29312 leader_election.cc:290] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:18.872081 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet d554c2be0f2a436ab5a0a62adcadbdd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e15ae22ba5d46c09b1cc9d99dce8b38) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:18.872686 28666 raft_consensus.cc:359] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.879984 29303 raft_consensus.cc:493] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:18.880445 29303 raft_consensus.cc:515] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.882449 29303 leader_election.cc:290] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:18.883858 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e70055265684586972191331e0dd5cd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:18.884438 28350 raft_consensus.cc:2468] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:18.885692 28142 leader_election.cc:304] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:18.886616 29303 raft_consensus.cc:2804] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:18.887028 29303 raft_consensus.cc:493] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:18.887507 29303 raft_consensus.cc:3060] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.902179 29328 tablet.cc:1751] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 07:56:18.873872 28434 leader_election.cc:343] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: f7489fefeac8420f973245e1b1bb2d6d
W20260928 07:56:18.904564 28434 leader_election.cc:343] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: f7489fefeac8420f973245e1b1bb2d6d
I20260928 07:56:18.905005 28434 leader_election.cc:304] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:18.906168 29312 raft_consensus.cc:2749] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:18.908332 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e70055265684586972191331e0dd5cd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:18.909799 28141 leader_election.cc:343] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:18.910799 28666 raft_consensus.cc:385] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.911123 28666 raft_consensus.cc:740] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.913969 28667 tablet_bootstrap.cc:492] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:18.913748 29330 tablet.cc:1751] T 48ed97fd35ee42f3957a18f48fac07bb P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:18.914520 28667 ts_tablet_manager.cc:1403] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.139s user 0.008s sys 0.002s
W20260928 07:56:18.916107 27813 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.253:45305, user_credentials={real_user=slave}} blocked reactor thread for 93983.5us
I20260928 07:56:18.895980 29303 raft_consensus.cc:515] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.922976 28662 tablet_bootstrap.cc:492] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:18.925565 28667 raft_consensus.cc:359] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.926440 28662 ts_tablet_manager.cc:1403] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.121s user 0.009s sys 0.004s
I20260928 07:56:18.936364 28656 ts_tablet_manager.cc:1929] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:18.895325 28498 raft_consensus.cc:1275] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Refusing update from remote peer 3bd67de620c94af3b7c8e3ba7d42f980: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:18.911971 28666 consensus_queue.cc:260] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.949860 28656 log.cc:1199] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/be116490ca57460688eaa2ff1c0415de
I20260928 07:56:18.950651 28656 ts_tablet_manager.cc:1950] T be116490ca57460688eaa2ff1c0415de P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:18.953115 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet be116490ca57460688eaa2ff1c0415de (table default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]) successfully deleted
I20260928 07:56:18.929061 28662 raft_consensus.cc:359] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:18.953836 28662 raft_consensus.cc:385] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.954172 28662 raft_consensus.cc:740] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.940728 29303 leader_election.cc:290] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:18.955195 28662 consensus_queue.cc:260] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:18.955482 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 41352cf9a4974e2b861d2234d9a5accd (DEFAULT_TABLE table=default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.938293 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e70055265684586972191331e0dd5cd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:18.946750 29283 consensus_queue.cc:1048] T 48ed97fd35ee42f3957a18f48fac07bb P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:18.957402 28350 raft_consensus.cc:3060] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.964761 28350 raft_consensus.cc:2468] T 3e70055265684586972191331e0dd5cd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:18.966176 28142 leader_election.cc:304] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:18.967104 29303 raft_consensus.cc:2804] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:18.967604 29303 raft_consensus.cc:697] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:18.967531 28667 raft_consensus.cc:385] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:18.968425 29303 consensus_queue.cc:237] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.970711 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 41352cf9a4974e2b861d2234d9a5accd (DEFAULT_TABLE table=default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:18.971946 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41352cf9a4974e2b861d2234d9a5accd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:18.973901 27827 catalog_manager.cc:5838] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:18.978279 29340 raft_consensus.cc:493] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:18.978807 29340 raft_consensus.cc:515] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.981348 28667 raft_consensus.cc:740] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.982401 28667 consensus_queue.cc:260] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:18.984445 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11be687831574f5c961f703b03ce2c68" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:18.985709 28141 leader_election.cc:343] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:18.985545 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11be687831574f5c961f703b03ce2c68" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:18.986364 28350 raft_consensus.cc:2468] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:18.986493 29340 leader_election.cc:290] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:18.975633 29296 raft_consensus.cc:359] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:18.987870 28142 leader_election.cc:304] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:18.988629 29296 raft_consensus.cc:740] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: b64b51f6f084474eb360161ac99f9b16, State: Initialized, Role: FOLLOWER
I20260928 07:56:18.988912 29041 ts_tablet_manager.cc:1929] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:18.989302 29041 log.cc:1199] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/be116490ca57460688eaa2ff1c0415de
I20260928 07:56:18.989450 29340 raft_consensus.cc:2804] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:18.989886 29340 raft_consensus.cc:493] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:18.990065 29041 ts_tablet_manager.cc:1950] T be116490ca57460688eaa2ff1c0415de P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:18.990278 29340 raft_consensus.cc:3060] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:18.991961 28658 ts_tablet_manager.cc:1929] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:18.993810 28662 ts_tablet_manager.cc:1434] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.067s user 0.005s sys 0.000s
I20260928 07:56:18.994705 28662 tablet_bootstrap.cc:492] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:18.995672 29296 consensus_queue.cc:260] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:19.005324 28253 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:56:19.007256 28658 log.cc:1199] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/4bc16584c61c4ebea9bdf4772630ef58
I20260928 07:56:19.008059 28658 ts_tablet_manager.cc:1950] T 4bc16584c61c4ebea9bdf4772630ef58 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:19.009441 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 179) took 1587 ms. Trace:
I20260928 07:56:19.024384 28667 ts_tablet_manager.cc:1434] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.110s user 0.007s sys 0.000s
I20260928 07:56:19.025046 29257 raft_consensus.cc:493] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:19.025945 28656 tablet_replica.cc:333] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:19.025586 29257 raft_consensus.cc:515] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.026757 28656 raft_consensus.cc:2243] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:19.027632 29257 leader_election.cc:290] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:19.000521 28666 ts_tablet_manager.cc:1434] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.130s user 0.006s sys 0.002s
I20260928 07:56:18.940394 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e70055265684586972191331e0dd5cd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:19.003917 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41352cf9a4974e2b861d2234d9a5accd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.046819 29344 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:19.054996 28656 raft_consensus.cc:2272] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 07:56:19.055192 28141 leader_election.cc:343] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:19.055670 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6fa66d29ca41b0b0d7ad8f30596aab" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:19.063993 28207 raft_consensus.cc:2393] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in this term.
I20260928 07:56:19.064319 28656 ts_tablet_manager.cc:1916] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:19.050961 29296 sys_catalog.cc:565] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 07:56:19.069106 29303 consensus_queue.cc:1048] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:19.069425 29344 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:56:19.071738 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6fa66d29ca41b0b0d7ad8f30596aab" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:19.073309 28434 leader_election.cc:304] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:19.074051 29257 raft_consensus.cc:3060] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:19.017094 27822 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_2a0111dbc5c34f6e9adeaff86b2c2769" } modify_external_catalogs: true
I20260928 07:56:19.077335 27822 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51542:
table { table_name: "default.Table_2a0111dbc5c34f6e9adeaff86b2c2769" } modify_external_catalogs: true
I20260928 07:56:19.081461 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet be116490ca57460688eaa2ff1c0415de (table default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]) successfully deleted
I20260928 07:56:19.083021 29336 tablet.cc:1751] T 48ed97fd35ee42f3957a18f48fac07bb P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:19.083575 28667 tablet_bootstrap.cc:492] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:19.089496 28667 tablet_bootstrap.cc:654] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.091918 28662 tablet_bootstrap.cc:654] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.094547 29041 tablet_replica.cc:333] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:19.095383 29041 raft_consensus.cc:2243] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:19.095917 29041 raft_consensus.cc:2272] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:19.062294 29340 raft_consensus.cc:515] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.097945 28666 tablet_bootstrap.cc:492] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:19.010843 28658 rpcz_store.cc:276] 0928 07:56:17.421712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:17.421852 (+ 140us) service_pool.cc:224] Handling call
0928 07:56:18.699848 (+1277996us) ts_tablet_manager.cc:1151] Deleting tablet 4bc16584c61c4ebea9bdf4772630ef58
0928 07:56:18.699894 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:18.854422 (+154528us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:18.991816 (+137394us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:19.009348 (+ 17532us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1277451}
I20260928 07:56:19.109702 28658 tablet_replica.cc:333] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:19.110657 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11be687831574f5c961f703b03ce2c68" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:19.111197 29340 leader_election.cc:290] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:19.113579 28350 raft_consensus.cc:3060] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:19.114668 28658 raft_consensus.cc:2243] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:19.131067 28662 tablet_bootstrap.cc:492] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:19.131584 28662 ts_tablet_manager.cc:1403] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.137s user 0.006s sys 0.005s
I20260928 07:56:19.138873 28662 raft_consensus.cc:359] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.139621 28662 raft_consensus.cc:385] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.139923 28662 raft_consensus.cc:740] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.140662 28662 consensus_queue.cc:260] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.142939 28662 ts_tablet_manager.cc:1434] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260928 07:56:19.154565 28658 raft_consensus.cc:2272] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:19.155308 28350 raft_consensus.cc:2468] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:19.156463 28662 tablet_bootstrap.cc:492] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:19.156497 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11be687831574f5c961f703b03ce2c68" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:19.159372 28141 leader_election.cc:343] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:19.162158 28142 leader_election.cc:304] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:19.163298 29340 raft_consensus.cc:2804] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:19.163769 29340 raft_consensus.cc:697] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:19.164805 29257 raft_consensus.cc:2749] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:19.164569 29340 consensus_queue.cc:237] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.153736 28656 ts_tablet_manager.cc:1929] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:19.177464 28656 log.cc:1199] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/d554c2be0f2a436ab5a0a62adcadbdd3
I20260928 07:56:19.178151 29041 ts_tablet_manager.cc:1916] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:19.180982 28656 ts_tablet_manager.cc:1950] T d554c2be0f2a436ab5a0a62adcadbdd3 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
W20260928 07:56:19.182293 27815 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 11be687831574f5c961f703b03ce2c68 consensus state has no leader
I20260928 07:56:19.185254 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet d554c2be0f2a436ab5a0a62adcadbdd3 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
I20260928 07:56:19.182222 28662 tablet_bootstrap.cc:654] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.198134 29283 raft_consensus.cc:493] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:19.198796 29283 raft_consensus.cc:515] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.203135 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b801232a1a4f4b0a80974fc838a3b6f5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:19.203859 28207 raft_consensus.cc:2468] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:19.205580 28286 leader_election.cc:304] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:19.206864 29335 raft_consensus.cc:2804] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:19.207432 29335 raft_consensus.cc:493] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:19.207942 29335 raft_consensus.cc:3060] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:19.221391 28658 ts_tablet_manager.cc:1916] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:19.223800 29283 leader_election.cc:290] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:19.229727 29340 consensus_queue.cc:1048] T 711949ab6f4548d09e06b849202d2d90 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:19.222046 28666 tablet_bootstrap.cc:654] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.227355 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b801232a1a4f4b0a80974fc838a3b6f5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:19.235968 28285 leader_election.cc:343] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:19.158412 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 4bc16584c61c4ebea9bdf4772630ef58 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
W20260928 07:56:19.249801 27814 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 91416.1us
I20260928 07:56:19.256781 29335 raft_consensus.cc:515] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.267688 28667 tablet_bootstrap.cc:492] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:19.268190 28667 ts_tablet_manager.cc:1403] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.185s user 0.007s sys 0.004s
I20260928 07:56:19.270560 28667 raft_consensus.cc:359] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:19.271417 28667 raft_consensus.cc:385] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.271773 28667 raft_consensus.cc:740] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.272599 28667 consensus_queue.cc:260] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:19.281438 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b801232a1a4f4b0a80974fc838a3b6f5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
W20260928 07:56:19.281778 28434 consensus_peers.cc:597] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e -> Peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Couldn't send request to peer acdaa3cf2ffd45f5b55a169c1bacead5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be116490ca57460688eaa2ff1c0415de. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:19.282025 28204 raft_consensus.cc:3060] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:19.296414 28204 raft_consensus.cc:2468] T b801232a1a4f4b0a80974fc838a3b6f5 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:19.320430 28666 tablet_bootstrap.cc:492] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:19.321015 28666 ts_tablet_manager.cc:1403] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.283s user 0.005s sys 0.008s
I20260928 07:56:19.324631 28666 raft_consensus.cc:359] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.325337 28666 raft_consensus.cc:385] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.325711 28666 raft_consensus.cc:740] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.327464 28662 tablet_bootstrap.cc:492] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:19.327905 28662 ts_tablet_manager.cc:1403] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.172s user 0.019s sys 0.033s
I20260928 07:56:19.330255 28662 raft_consensus.cc:359] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:19.330840 28662 raft_consensus.cc:385] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.331112 28662 raft_consensus.cc:740] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.331892 28662 consensus_queue.cc:260] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:19.335773 28662 ts_tablet_manager.cc:1434] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260928 07:56:19.369630 28666 consensus_queue.cc:260] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.377041 29353 raft_consensus.cc:493] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:19.377709 29353 raft_consensus.cc:515] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:19.381448 29353 leader_election.cc:290] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:19.381605 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d139c0b8379446dfba037e96e0501a0b" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:19.383250 28141 leader_election.cc:343] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:19.386530 28666 ts_tablet_manager.cc:1434] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.065s user 0.005s sys 0.000s
I20260928 07:56:19.405757 28666 tablet_bootstrap.cc:492] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:19.297684 28286 leader_election.cc:304] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
W20260928 07:56:19.409945 28286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 112328us
I20260928 07:56:19.410900 29283 raft_consensus.cc:2804] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:19.411474 29283 raft_consensus.cc:697] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:19.412448 29283 consensus_queue.cc:237] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.364792 28397 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:56:19.381193 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d139c0b8379446dfba037e96e0501a0b" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:19.420984 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b801232a1a4f4b0a80974fc838a3b6f5" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:19.423007 28142 leader_election.cc:343] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:19.423421 28142 leader_election.cc:304] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
W20260928 07:56:19.423571 28285 leader_election.cc:343] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:19.424464 29353 raft_consensus.cc:2749] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:19.429150 27824 catalog_manager.cc:5838] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:19.433825 29335 leader_election.cc:290] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:19.440277 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 9eaff4ec62804f00a750d1d31f44366d (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.441484 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eaff4ec62804f00a750d1d31f44366d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.443264 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 9eaff4ec62804f00a750d1d31f44366d (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.444314 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eaff4ec62804f00a750d1d31f44366d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.463953 28658 ts_tablet_manager.cc:1929] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:19.464357 28658 log.cc:1199] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/0099ff638ea34b8c8497f0193e51ad7d
I20260928 07:56:19.465031 28658 ts_tablet_manager.cc:1950] T 0099ff638ea34b8c8497f0193e51ad7d P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
W20260928 07:56:19.471982 28434 consensus_peers.cc:597] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e -> Peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Couldn't send request to peer 3bd67de620c94af3b7c8e3ba7d42f980. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be116490ca57460688eaa2ff1c0415de. This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:19.472918 28662 tablet_bootstrap.cc:492] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:19.474028 28666 tablet_bootstrap.cc:654] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.474541 28667 ts_tablet_manager.cc:1434] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.206s user 0.006s sys 0.001s
I20260928 07:56:19.475665 28667 tablet_bootstrap.cc:492] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:19.479233 28662 tablet_bootstrap.cc:654] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.484529 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 9eaff4ec62804f00a750d1d31f44366d (DEFAULT_TABLE table=default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.485702 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eaff4ec62804f00a750d1d31f44366d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.486009 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 181) took 1643 ms. Trace:
I20260928 07:56:19.486302 28658 rpcz_store.cc:276] 0928 07:56:17.842574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:17.842717 (+ 143us) service_pool.cc:224] Handling call
0928 07:56:19.109535 (+1266818us) ts_tablet_manager.cc:1151] Deleting tablet 0099ff638ea34b8c8497f0193e51ad7d
0928 07:56:19.109584 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:19.356490 (+246906us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:19.463816 (+107326us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:19.485950 (+ 22134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1265893}
I20260928 07:56:19.486761 28327 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5a4815e0004b5e827e30ccbe9073f1 (DEFAULT_TABLE table=default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.487494 28658 tablet_replica.cc:333] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:19.488030 28327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5a4815e0004b5e827e30ccbe9073f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.488193 28658 raft_consensus.cc:2243] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:19.490536 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 0099ff638ea34b8c8497f0193e51ad7d (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:19.489056 28658 raft_consensus.cc:2272] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:19.503191 28662 tablet_bootstrap.cc:492] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:19.503628 28662 ts_tablet_manager.cc:1403] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.006s
I20260928 07:56:19.504995 28658 ts_tablet_manager.cc:1916] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:19.506234 28662 raft_consensus.cc:359] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.506942 28662 raft_consensus.cc:385] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.507205 28662 raft_consensus.cc:740] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.508070 28662 consensus_queue.cc:260] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.510485 28662 ts_tablet_manager.cc:1434] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260928 07:56:19.528564 29284 consensus_queue.cc:1048] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:19.562229 27827 catalog_manager.cc:6391] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: default.table_2519a070e9974faeb26f6bcd4756d344 [id=5ede51d78549417b8bfc039f2d7c87f6] alter complete (version 1)
I20260928 07:56:19.600131 28658 ts_tablet_manager.cc:1929] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:19.600617 28658 log.cc:1199] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/8e64d9a4cd23460a8b311ced5acf4170
I20260928 07:56:19.607292 28658 ts_tablet_manager.cc:1950] T 8e64d9a4cd23460a8b311ced5acf4170 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:19.618990 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5a4815e0004b5e827e30ccbe9073f1 (DEFAULT_TABLE table=default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.620169 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5a4815e0004b5e827e30ccbe9073f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.620105 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5a4815e0004b5e827e30ccbe9073f1 (DEFAULT_TABLE table=default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.623312 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.624440 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.628937 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.630013 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.649999 29284 consensus_queue.cc:1048] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:19.674090 29041 ts_tablet_manager.cc:1929] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:19.675040 29041 log.cc:1199] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/d554c2be0f2a436ab5a0a62adcadbdd3
I20260928 07:56:19.675922 29041 ts_tablet_manager.cc:1950] T d554c2be0f2a436ab5a0a62adcadbdd3 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:19.693017 29353 raft_consensus.cc:493] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:19.693509 29353 raft_consensus.cc:515] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.693549 27824 catalog_manager.cc:5838] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:19.695467 29353 leader_election.cc:290] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:19.702086 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eaff4ec62804f00a750d1d31f44366d" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:19.703471 28141 leader_election.cc:343] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
W20260928 07:56:19.704027 28142 leader_election.cc:343] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Not found: Tablet not found: 9eaff4ec62804f00a750d1d31f44366d
I20260928 07:56:19.704433 28142 leader_election.cc:304] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:19.705586 29353 raft_consensus.cc:2749] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:19.716410 28667 tablet_bootstrap.cc:654] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.729063 29349 raft_consensus.cc:493] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:19.729704 29349 raft_consensus.cc:515] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.732280 29349 leader_election.cc:290] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:19.733875 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11be687831574f5c961f703b03ce2c68" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:19.734638 28350 raft_consensus.cc:2393] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:19.736220 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11be687831574f5c961f703b03ce2c68" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:19.737893 28434 leader_election.cc:304] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:19.738626 29349 raft_consensus.cc:3060] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:19.743131 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 (DEFAULT_TABLE table=default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:19.748703 29349 raft_consensus.cc:2749] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:19.750169 28666 tablet_bootstrap.cc:492] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:19.750574 28666 ts_tablet_manager.cc:1403] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.345s user 0.033s sys 0.082s
I20260928 07:56:19.756146 27827 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]). Expected version 1 got 0
I20260928 07:56:19.758283 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet d554c2be0f2a436ab5a0a62adcadbdd3 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
I20260928 07:56:19.765264 28662 tablet_bootstrap.cc:492] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:19.770718 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 183) took 1733 ms. Trace:
I20260928 07:56:19.771090 28658 rpcz_store.cc:276] 0928 07:56:18.037456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.037618 (+ 162us) service_pool.cc:224] Handling call
0928 07:56:19.487347 (+1449729us) ts_tablet_manager.cc:1151] Deleting tablet 8e64d9a4cd23460a8b311ced5acf4170
0928 07:56:19.487390 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:19.577334 (+ 89944us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:19.599997 (+ 22663us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:19.770652 (+170655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264960,"tablet-delete.queue_time_us":1449175}
I20260928 07:56:19.772208 28658 tablet_replica.cc:333] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:19.772385 28662 tablet_bootstrap.cc:654] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.772580 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 8e64d9a4cd23460a8b311ced5acf4170 (table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]) successfully deleted
I20260928 07:56:19.772924 28658 raft_consensus.cc:2243] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:19.773702 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.777287 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5a4815e0004b5e827e30ccbe9073f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:19.782670 28667 tablet_bootstrap.cc:492] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:19.783179 28667 ts_tablet_manager.cc:1403] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.308s user 0.007s sys 0.003s
I20260928 07:56:19.784334 28658 raft_consensus.cc:2272] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:19.786231 28658 ts_tablet_manager.cc:1916] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:19.796363 28662 tablet_bootstrap.cc:492] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:19.796816 28662 ts_tablet_manager.cc:1403] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.004s
I20260928 07:56:19.808640 28667 raft_consensus.cc:359] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:19.809866 28667 raft_consensus.cc:385] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.810249 28667 raft_consensus.cc:740] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.814327 28477 tablet_service.cc:1558] Processing DeleteTablet for tablet 0099ff638ea34b8c8497f0193e51ad7d with delete_type TABLET_DATA_DELETED (replaced by tablet 11be687831574f5c961f703b03ce2c68) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:19.799832 28662 raft_consensus.cc:359] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.817370 28662 raft_consensus.cc:385] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.817657 28662 raft_consensus.cc:740] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.818262 28667 consensus_queue.cc:260] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:19.821664 28662 consensus_queue.cc:260] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.824987 27824 catalog_manager.cc:5838] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:19.838552 28667 ts_tablet_manager.cc:1434] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.055s user 0.008s sys 0.000s
I20260928 07:56:19.839538 28667 tablet_bootstrap.cc:492] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:19.752759 28666 raft_consensus.cc:359] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.841472 28666 raft_consensus.cc:385] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.841790 28666 raft_consensus.cc:740] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.843918 27824 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:19.848223 28666 consensus_queue.cc:260] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.850131 28666 ts_tablet_manager.cc:1434] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.099s user 0.006s sys 0.000s
I20260928 07:56:19.826678 27827 master_service.cc:960] ReplaceTablet: received request to replace tablet 1ac50af1b39345b8a75ba38ba06de5a1 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:19.874233 27827 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 1ac50af1b39345b8a75ba38ba06de5a1
I20260928 07:56:19.876036 28666 tablet_bootstrap.cc:492] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:19.878458 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ac50af1b39345b8a75ba38ba06de5a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fe80328a63344f78528b8537b3dbf0c) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:19.880782 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ac50af1b39345b8a75ba38ba06de5a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fe80328a63344f78528b8537b3dbf0c) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:19.881546 29041 tablet_replica.cc:333] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:19.882342 29041 raft_consensus.cc:2243] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:19.882863 29041 raft_consensus.cc:2272] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:19.884692 29041 ts_tablet_manager.cc:1916] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:19.885504 29353 raft_consensus.cc:493] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:19.885978 29353 raft_consensus.cc:515] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:19.887997 29353 leader_election.cc:290] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:19.889612 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41352cf9a4974e2b861d2234d9a5accd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:19.890215 28350 raft_consensus.cc:2468] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:19.891538 28142 leader_election.cc:304] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:19.892556 29353 raft_consensus.cc:2804] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:19.892928 29353 raft_consensus.cc:493] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:19.893371 29353 raft_consensus.cc:3060] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:19.908282 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41352cf9a4974e2b861d2234d9a5accd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:19.910737 28141 leader_election.cc:343] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:19.912328 28658 ts_tablet_manager.cc:1929] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 07:56:19.912693 28658 log.cc:1199] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/f7489fefeac8420f973245e1b1bb2d6d
I20260928 07:56:19.913339 28658 ts_tablet_manager.cc:1950] T f7489fefeac8420f973245e1b1bb2d6d P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:19.920886 27827 catalog_manager.cc:6934] ReplaceTablet: tablet 1ac50af1b39345b8a75ba38ba06de5a1 deleted and replaced by tablet 8fe80328a63344f78528b8537b3dbf0c
I20260928 07:56:19.916392 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ac50af1b39345b8a75ba38ba06de5a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fe80328a63344f78528b8537b3dbf0c) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:19.919080 28666 tablet_bootstrap.cc:654] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.922582 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 184) took 1570 ms. Trace:
I20260928 07:56:19.922956 28658 rpcz_store.cc:276] 0928 07:56:18.352507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.352635 (+ 128us) service_pool.cc:224] Handling call
0928 07:56:19.772064 (+1419429us) ts_tablet_manager.cc:1151] Deleting tablet f7489fefeac8420f973245e1b1bb2d6d
0928 07:56:19.772105 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:19.839608 (+ 67503us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:19.912193 (+ 72585us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:19.922524 (+ 10331us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1397039}
I20260928 07:56:19.924281 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet f7489fefeac8420f973245e1b1bb2d6d (table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]) successfully deleted
I20260928 07:56:19.926436 28662 ts_tablet_manager.cc:1434] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.129s user 0.003s sys 0.004s
I20260928 07:56:19.925184 28658 tablet_replica.cc:333] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:19.927397 28658 raft_consensus.cc:2243] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:19.942240 28667 tablet_bootstrap.cc:654] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:19.944864 28658 raft_consensus.cc:2272] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:19.947125 28658 ts_tablet_manager.cc:1916] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:19.954185 28666 tablet_bootstrap.cc:492] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:19.954636 28666 ts_tablet_manager.cc:1403] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.004s
I20260928 07:56:19.959713 28662 tablet_bootstrap.cc:492] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:19.964139 29377 tablet_replica.cc:333] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:19.968204 28658 ts_tablet_manager.cc:1929] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:19.971606 28666 raft_consensus.cc:359] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.982100 28666 raft_consensus.cc:385] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:19.982223 28658 log.cc:1199] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/be116490ca57460688eaa2ff1c0415de
I20260928 07:56:19.982435 28666 raft_consensus.cc:740] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:19.983165 28658 ts_tablet_manager.cc:1950] T be116490ca57460688eaa2ff1c0415de P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:19.983217 28666 consensus_queue.cc:260] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:19.985150 28666 ts_tablet_manager.cc:1434] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.030s user 0.003s sys 0.001s
I20260928 07:56:19.985991 28666 tablet_bootstrap.cc:492] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:20.000317 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe80328a63344f78528b8537b3dbf0c (DEFAULT_TABLE table=default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:20.001448 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe80328a63344f78528b8537b3dbf0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:20.008813 28666 tablet_bootstrap.cc:654] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.009408 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe80328a63344f78528b8537b3dbf0c (DEFAULT_TABLE table=default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:20.010721 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe80328a63344f78528b8537b3dbf0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:20.010954 29377 raft_consensus.cc:2243] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:20.018555 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 188) took 1241 ms. Trace:
I20260928 07:56:20.005856 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 8fe80328a63344f78528b8537b3dbf0c (DEFAULT_TABLE table=default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:20.019320 29377 raft_consensus.cc:2272] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:20.018942 28658 rpcz_store.cc:276] 0928 07:56:18.777698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.778031 (+ 333us) service_pool.cc:224] Handling call
0928 07:56:19.925033 (+1147002us) ts_tablet_manager.cc:1151] Deleting tablet be116490ca57460688eaa2ff1c0415de
0928 07:56:19.925074 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:19.958051 (+ 32977us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:19.968083 (+ 10032us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:20.018486 (+ 50403us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1146502}
I20260928 07:56:20.019867 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe80328a63344f78528b8537b3dbf0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:20.020458 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet be116490ca57460688eaa2ff1c0415de (table default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519]) successfully deleted
I20260928 07:56:19.920809 29353 raft_consensus.cc:515] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.021397 28658 tablet_replica.cc:333] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:20.022758 28658 raft_consensus.cc:2243] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:20.023586 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41352cf9a4974e2b861d2234d9a5accd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:20.024184 28350 raft_consensus.cc:3060] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.026540 28658 raft_consensus.cc:2272] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:20.030805 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41352cf9a4974e2b861d2234d9a5accd" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:20.031811 28350 raft_consensus.cc:2468] T 41352cf9a4974e2b861d2234d9a5accd P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
W20260928 07:56:20.032208 28141 leader_election.cc:343] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:20.032996 28142 leader_election.cc:304] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:20.038749 28658 ts_tablet_manager.cc:1916] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:20.046097 29353 leader_election.cc:290] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:20.048418 28667 tablet_bootstrap.cc:492] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:20.049441 29353 raft_consensus.cc:2804] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:20.051288 29377 ts_tablet_manager.cc:1916] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:20.051663 29353 raft_consensus.cc:697] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:20.060333 29353 consensus_queue.cc:237] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.061750 28667 ts_tablet_manager.cc:1403] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.222s user 0.013s sys 0.001s
I20260928 07:56:20.064270 28499 raft_consensus.cc:3060] T 3e70055265684586972191331e0dd5cd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:19.989033 29041 ts_tablet_manager.cc:1929] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:20.065471 29041 log.cc:1199] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/1ac50af1b39345b8a75ba38ba06de5a1
I20260928 07:56:20.066198 29041 ts_tablet_manager.cc:1950] T 1ac50af1b39345b8a75ba38ba06de5a1 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:20.067579 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 1ac50af1b39345b8a75ba38ba06de5a1 (table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]) successfully deleted
I20260928 07:56:20.080601 28658 ts_tablet_manager.cc:1929] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:20.080988 28658 log.cc:1199] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/d554c2be0f2a436ab5a0a62adcadbdd3
I20260928 07:56:20.081810 28658 ts_tablet_manager.cc:1950] T d554c2be0f2a436ab5a0a62adcadbdd3 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:20.050077 28662 tablet_bootstrap.cc:654] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.089071 29383 consensus_queue.cc:1048] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:20.094661 28658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50372 (request call id 189) took 1225 ms. Trace:
I20260928 07:56:20.095041 28658 rpcz_store.cc:276] 0928 07:56:18.869634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.871926 (+ 2292us) service_pool.cc:224] Handling call
0928 07:56:20.021242 (+1149316us) ts_tablet_manager.cc:1151] Deleting tablet d554c2be0f2a436ab5a0a62adcadbdd3
0928 07:56:20.021288 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:20.069757 (+ 48469us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:20.080478 (+ 10721us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:20.094584 (+ 14106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1148765}
I20260928 07:56:20.096417 28666 tablet_bootstrap.cc:492] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:20.096341 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet d554c2be0f2a436ab5a0a62adcadbdd3 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
I20260928 07:56:20.096796 28666 ts_tablet_manager.cc:1403] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.111s user 0.013s sys 0.010s
W20260928 07:56:20.098063 27814 catalog_manager.cc:5030] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 0099ff638ea34b8c8497f0193e51ad7d because the tablet was not found. No further retry: Not found: Tablet not found: 0099ff638ea34b8c8497f0193e51ad7d
I20260928 07:56:20.099347 28658 tablet_replica.cc:333] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:20.100903 28666 raft_consensus.cc:359] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.105353 28666 raft_consensus.cc:385] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.105619 28666 raft_consensus.cc:740] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.106084 28658 raft_consensus.cc:2243] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:20.106968 28658 raft_consensus.cc:2272] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:20.107388 27827 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:20.108765 28658 ts_tablet_manager.cc:1916] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:20.111078 28544 heartbeater.cc:344] Connected to a master server at 127.26.221.252:41205
I20260928 07:56:20.064958 28667 raft_consensus.cc:359] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.111913 28667 raft_consensus.cc:385] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.112190 28667 raft_consensus.cc:740] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.112931 28667 consensus_queue.cc:260] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.106308 28666 consensus_queue.cc:260] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.115914 28666 ts_tablet_manager.cc:1434] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.019s user 0.003s sys 0.004s
I20260928 07:56:20.116789 28666 tablet_bootstrap.cc:492] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:20.147672 28666 tablet_bootstrap.cc:654] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.154613 28658 ts_tablet_manager.cc:1929] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:20.155118 28658 log.cc:1199] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/1ac50af1b39345b8a75ba38ba06de5a1
I20260928 07:56:20.159245 28658 ts_tablet_manager.cc:1950] T 1ac50af1b39345b8a75ba38ba06de5a1 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:20.160908 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 1ac50af1b39345b8a75ba38ba06de5a1 (table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]) successfully deleted
I20260928 07:56:20.169478 28667 ts_tablet_manager.cc:1434] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.107s user 0.006s sys 0.000s
I20260928 07:56:20.174072 28667 tablet_bootstrap.cc:492] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
W20260928 07:56:20.202927 28142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 57742.9us
I20260928 07:56:20.205746 28662 tablet_bootstrap.cc:492] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:20.206214 28662 ts_tablet_manager.cc:1403] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.247s user 0.007s sys 0.003s
I20260928 07:56:20.208624 28662 raft_consensus.cc:359] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.211897 29387 consensus_queue.cc:1048] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:20.242657 29381 consensus_queue.cc:1048] T 3e70055265684586972191331e0dd5cd P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260928 07:56:20.271451 29387 consensus_queue.cc:1048] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:20.286639 29389 raft_consensus.cc:493] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:20.287207 29389 raft_consensus.cc:515] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.288494 28667 tablet_bootstrap.cc:654] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.290814 29389 leader_election.cc:290] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:20.292478 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5a4815e0004b5e827e30ccbe9073f1" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
W20260928 07:56:20.294016 28141 leader_election.cc:343] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:20.294100 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5a4815e0004b5e827e30ccbe9073f1" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:20.294833 28351 raft_consensus.cc:2468] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:20.299628 28666 tablet_bootstrap.cc:492] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:20.300096 28666 ts_tablet_manager.cc:1403] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.183s user 0.015s sys 0.013s
I20260928 07:56:20.302560 28666 raft_consensus.cc:359] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.303191 28666 raft_consensus.cc:385] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.303663 28666 raft_consensus.cc:740] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.304493 28666 consensus_queue.cc:260] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.306742 28666 ts_tablet_manager.cc:1434] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260928 07:56:20.307560 28666 tablet_bootstrap.cc:492] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
W20260928 07:56:20.314870 29390 log.cc:927] Time spent T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Append to log took a long time: real 0.107s user 0.013s sys 0.000s
I20260928 07:56:20.317041 28142 leader_election.cc:304] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:20.318353 29381 raft_consensus.cc:2804] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:20.318782 29381 raft_consensus.cc:493] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:20.319249 29381 raft_consensus.cc:3060] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.317700 29344 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 4 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:20.321822 29344 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:56:20.318526 29375 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:20.322492 29375 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:20.333501 28662 raft_consensus.cc:385] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.333873 28662 raft_consensus.cc:740] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.334527 28662 consensus_queue.cc:260] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.336704 28662 ts_tablet_manager.cc:1434] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.130s user 0.000s sys 0.006s
I20260928 07:56:20.355979 28662 tablet_bootstrap.cc:492] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:20.359974 29375 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
W20260928 07:56:20.362172 27815 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2aac87ee995c415f8c4151ca1b926b10 consensus state has no leader
I20260928 07:56:20.369911 29376 raft_consensus.cc:493] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:20.370409 29376 raft_consensus.cc:515] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.372406 29376 leader_election.cc:290] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:20.374183 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d139c0b8379446dfba037e96e0501a0b" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:20.374528 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d139c0b8379446dfba037e96e0501a0b" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:20.374831 28351 raft_consensus.cc:2468] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:20.375075 28207 raft_consensus.cc:2468] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:20.376210 28434 leader_election.cc:304] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:20.377388 29376 raft_consensus.cc:2804] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:20.377710 29376 raft_consensus.cc:493] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:20.378019 29376 raft_consensus.cc:3060] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.385833 29376 raft_consensus.cc:515] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.403872 29381 raft_consensus.cc:515] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.407069 28667 tablet_bootstrap.cc:492] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:20.407617 28667 ts_tablet_manager.cc:1403] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.234s user 0.011s sys 0.000s
I20260928 07:56:20.407425 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5a4815e0004b5e827e30ccbe9073f1" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:20.408839 28141 leader_election.cc:343] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:20.411321 28351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5a4815e0004b5e827e30ccbe9073f1" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:20.411959 28351 raft_consensus.cc:3060] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.419509 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d139c0b8379446dfba037e96e0501a0b" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:20.420076 28350 raft_consensus.cc:3060] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.419591 27824 catalog_manager.cc:5838] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:20.421442 28666 tablet_bootstrap.cc:654] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.424542 29377 ts_tablet_manager.cc:1929] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:20.424944 29377 log.cc:1199] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/1ac50af1b39345b8a75ba38ba06de5a1
I20260928 07:56:20.425768 29377 ts_tablet_manager.cc:1950] T 1ac50af1b39345b8a75ba38ba06de5a1 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:20.427186 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 1ac50af1b39345b8a75ba38ba06de5a1 (table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]) successfully deleted
I20260928 07:56:20.427362 28350 raft_consensus.cc:2468] T d139c0b8379446dfba037e96e0501a0b P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:20.428637 28434 leader_election.cc:304] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:20.428853 28662 tablet_bootstrap.cc:654] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.431273 28667 raft_consensus.cc:359] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.441313 29381 leader_election.cc:290] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:20.444121 29376 leader_election.cc:290] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:20.444801 29376 raft_consensus.cc:2804] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:20.445286 29376 raft_consensus.cc:697] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:20.446067 29376 consensus_queue.cc:237] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:20.459143 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d139c0b8379446dfba037e96e0501a0b" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:20.459700 28207 raft_consensus.cc:3060] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.469807 29335 consensus_queue.cc:1048] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:20.477451 28207 raft_consensus.cc:2468] T d139c0b8379446dfba037e96e0501a0b P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:20.477718 29238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37112 (request call id 0) took 2215 ms. Trace:
I20260928 07:56:20.483606 28499 raft_consensus.cc:3060] T b801232a1a4f4b0a80974fc838a3b6f5 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.494277 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 237 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:20.516389 29419 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 07:56:20.518251 27913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 237 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:56:20.531287 29414 consensus_queue.cc:1048] T b801232a1a4f4b0a80974fc838a3b6f5 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:20.532543 29132 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16; no voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:56:20.533766 29375 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 07:56:20.457013 28667 raft_consensus.cc:385] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.540851 28667 raft_consensus.cc:740] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.542896 28667 consensus_queue.cc:260] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.587481 28666 tablet_bootstrap.cc:492] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:20.587994 28666 ts_tablet_manager.cc:1403] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.281s user 0.008s sys 0.012s
I20260928 07:56:20.590521 28666 raft_consensus.cc:359] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.592808 28666 raft_consensus.cc:385] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.593485 28666 raft_consensus.cc:740] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.595221 28666 consensus_queue.cc:260] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.597697 28662 tablet_bootstrap.cc:492] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:20.598335 28662 ts_tablet_manager.cc:1403] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.243s user 0.018s sys 0.004s
I20260928 07:56:20.601105 28662 raft_consensus.cc:359] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.603344 28662 raft_consensus.cc:385] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.603948 28666 ts_tablet_manager.cc:1434] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20260928 07:56:20.455682 28351 raft_consensus.cc:2468] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:20.604259 28662 raft_consensus.cc:740] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.605472 28142 leader_election.cc:304] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:20.606956 28667 ts_tablet_manager.cc:1434] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.199s user 0.005s sys 0.002s
I20260928 07:56:20.607435 29381 raft_consensus.cc:2804] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:20.607962 28667 tablet_bootstrap.cc:492] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:20.607884 29381 raft_consensus.cc:697] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:20.608631 29381 consensus_queue.cc:237] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.609479 28666 tablet_bootstrap.cc:492] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
W20260928 07:56:20.611866 28089 hms_client.cc:345] Time spent alter HMS table: real 1.309s user 0.001s sys 0.000s
I20260928 07:56:20.613037 27821 catalog_manager.cc:3541] renamed table default.table_33b6d1f71f5b44d0aec9c0f698e7d014 [id=7d3bf1f44d9443b78713cb43948ae519] in HMS: new name default.table_da656d08cd28419b8599a14b3946a15a
I20260928 07:56:20.618446 28666 tablet_bootstrap.cc:654] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.539492 27827 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:20.628410 29216 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" instance_seqno: 1790582152703629) as {username='slave'} at 127.26.221.193:45369; Asking this server to re-register.
I20260928 07:56:20.641546 28253 heartbeater.cc:461] Registering TS with master...
I20260928 07:56:20.647244 29212 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" instance_seqno: 1790582157130867) as {username='slave'} at 127.26.221.195:34459; Asking this server to re-register.
I20260928 07:56:20.608777 28662 consensus_queue.cc:260] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.652248 28662 ts_tablet_manager.cc:1434] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.054s user 0.006s sys 0.000s
I20260928 07:56:20.655119 28544 heartbeater.cc:461] Registering TS with master...
I20260928 07:56:20.657208 28667 tablet_bootstrap.cc:654] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.666911 27824 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:20.674331 29416 raft_consensus.cc:493] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:20.674837 29416 raft_consensus.cc:515] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.676947 29416 leader_election.cc:290] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:20.678344 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eaff4ec62804f00a750d1d31f44366d" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:20.678938 28207 raft_consensus.cc:2468] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:20.681046 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eaff4ec62804f00a750d1d31f44366d" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:20.681668 28499 raft_consensus.cc:2468] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:20.683085 28286 leader_election.cc:304] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:20.684113 29417 raft_consensus.cc:2804] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:20.684433 29417 raft_consensus.cc:493] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:20.684731 29417 raft_consensus.cc:3060] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.687544 29216 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" instance_seqno: 1790582154796083) as {username='slave'} at 127.26.221.194:50711; Asking this server to re-register.
I20260928 07:56:20.692081 28397 heartbeater.cc:461] Registering TS with master...
I20260928 07:56:20.698350 29212 ts_manager.cc:194] Registered new tserver with Master: acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:20.699747 27824 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:20.701671 28667 tablet_bootstrap.cc:492] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:20.702105 28667 ts_tablet_manager.cc:1403] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.094s user 0.006s sys 0.003s
I20260928 07:56:20.704385 29417 raft_consensus.cc:515] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.712575 29216 ts_manager.cc:194] Registered new tserver with Master: 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:20.708690 28667 raft_consensus.cc:359] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.715158 28667 raft_consensus.cc:385] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.715415 28667 raft_consensus.cc:740] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.714938 27824 catalog_manager.cc:5838] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:20.722076 28667 consensus_queue.cc:260] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.722616 28666 tablet_bootstrap.cc:492] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:20.723515 28666 ts_tablet_manager.cc:1403] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.116s user 0.008s sys 0.003s
I20260928 07:56:20.724071 28667 ts_tablet_manager.cc:1434] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260928 07:56:20.726086 28666 raft_consensus.cc:359] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.726691 28666 raft_consensus.cc:385] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.730501 29417 leader_election.cc:290] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:20.733507 28666 raft_consensus.cc:740] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.734193 28666 consensus_queue.cc:260] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.735682 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eaff4ec62804f00a750d1d31f44366d" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:20.736186 28499 raft_consensus.cc:3060] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.746345 28499 raft_consensus.cc:2468] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:20.747584 28285 leader_election.cc:304] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:20.749186 29416 raft_consensus.cc:2804] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:20.749660 29416 raft_consensus.cc:697] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:20.750453 29416 consensus_queue.cc:237] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.755251 28667 tablet_bootstrap.cc:492] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:20.765758 28667 tablet_bootstrap.cc:654] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.774827 29212 ts_manager.cc:194] Registered new tserver with Master: bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:20.780141 27824 catalog_manager.cc:5838] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:20.798840 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eaff4ec62804f00a750d1d31f44366d" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:20.799746 28207 raft_consensus.cc:3060] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.736176 28666 ts_tablet_manager.cc:1434] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20260928 07:56:20.824843 28666 tablet_bootstrap.cc:492] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:20.825649 28207 raft_consensus.cc:2468] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:20.834877 28667 tablet_bootstrap.cc:492] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:20.835301 28667 ts_tablet_manager.cc:1403] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.005s
I20260928 07:56:20.837666 28667 raft_consensus.cc:359] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.838271 28667 raft_consensus.cc:385] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.847275 28667 raft_consensus.cc:740] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.792085 27827 master_service.cc:960] ReplaceTablet: received request to replace tablet 9b6fa66d29ca41b0b0d7ad8f30596aab from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:20.808228 27823 catalog_manager.cc:2213] created HMS catalog entry for table [id=c10445efe1fa43b2a9e79b12c9a6da55]
I20260928 07:56:20.870335 29431 tablet.cc:1751] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:20.872197 28666 tablet_bootstrap.cc:654] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.875927 27823 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 140) took 2425 ms. Trace:
I20260928 07:56:20.876262 27823 rpcz_store.cc:276] 0928 07:56:18.450779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.452967 (+ 2188us) service_pool.cc:224] Handling call
0928 07:56:18.587018 (+134051us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:18.588566 (+ 1548us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:20.808179 (+2219613us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:20.875225 (+ 67046us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:20.875562 (+ 337us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:20.875853 (+ 291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:20.859321 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:20.859813 (+ 492us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:20.859846 (+ 33us) write_op.cc:435] Acquired schema lock
0928 07:56:20.859866 (+ 20us) tablet.cc:662] Decoding operations
0928 07:56:20.860210 (+ 344us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:20.860274 (+ 64us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:20.860306 (+ 32us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:20.860544 (+ 238us) tablet.cc:701] Row locks acquired
0928 07:56:20.860563 (+ 19us) write_op.cc:260] PREPARE: finished
0928 07:56:20.860693 (+ 130us) write_op.cc:270] Start()
0928 07:56:20.860794 (+ 101us) write_op.cc:276] Timestamp: P: 1790582180860610 usec, L: 0
0928 07:56:20.860814 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 07:56:20.861534 (+ 720us) log.cc:844] Serialized 433 byte log entry
0928 07:56:20.871400 (+ 9866us) op_driver.cc:464] REPLICATION: finished
0928 07:56:20.871757 (+ 357us) write_op.cc:301] APPLY: starting
0928 07:56:20.871816 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:20.871923 (+ 107us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:20.872034 (+ 111us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:20.872462 (+ 428us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:20.872610 (+ 148us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:20.872653 (+ 43us) write_op.cc:312] APPLY: finished
0928 07:56:20.872854 (+ 201us) log.cc:844] Serialized 29 byte log entry
0928 07:56:20.873009 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:20.873085 (+ 76us) write_op.cc:454] Released schema lock
0928 07:56:20.873120 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:20.873374 (+ 254us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:20.873401 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2023440,"Hive Metastore.run_cpu_time_us":676,"Hive Metastore.run_wall_time_us":195279,"child_traces":[["op",{"apply.queue_time_us":218,"apply.run_cpu_time_us":1580,"apply.run_wall_time_us":1580,"num_ops":2,"prepare.queue_time_us":298,"prepare.run_cpu_time_us":2512,"prepare.run_wall_time_us":2601,"raft.queue_time_us":1289,"raft.run_cpu_time_us":628,"raft.run_wall_time_us":629,"replication_time_us":10489}]]}
I20260928 07:56:20.887195 28666 tablet_bootstrap.cc:492] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:20.887617 28666 ts_tablet_manager.cc:1403] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.063s user 0.009s sys 0.000s
I20260928 07:56:20.866200 28667 consensus_queue.cc:260] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.900674 28667 ts_tablet_manager.cc:1434] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.065s user 0.007s sys 0.001s
I20260928 07:56:20.916043 28666 raft_consensus.cc:359] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.916720 28666 raft_consensus.cc:385] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:20.917002 28666 raft_consensus.cc:740] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.923476 28666 consensus_queue.cc:260] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.927878 27827 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 9b6fa66d29ca41b0b0d7ad8f30596aab
I20260928 07:56:20.945539 28184 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab with delete_type TABLET_DATA_DELETED (replaced by tablet 62bc065c9f2743c9ae79dc37bc6de0c2) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:20.951161 29435 tablet_replica.cc:333] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:20.971166 27828 catalog_manager.cc:2213] created HMS catalog entry for table [id=d339f7eb2ccd40fa88e0ba9a4dff6595]
I20260928 07:56:20.936444 28666 ts_tablet_manager.cc:1434] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.049s user 0.007s sys 0.000s
I20260928 07:56:20.972488 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab with delete_type TABLET_DATA_DELETED (replaced by tablet 62bc065c9f2743c9ae79dc37bc6de0c2) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:20.974020 29417 raft_consensus.cc:493] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:20.974488 29417 raft_consensus.cc:515] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:20.977404 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15ae22ba5d46c09b1cc9d99dce8b38" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:20.978005 28207 raft_consensus.cc:2468] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:20.979413 28286 leader_election.cc:304] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:20.980188 29416 raft_consensus.cc:2804] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:20.980559 29416 raft_consensus.cc:493] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:20.980854 29416 raft_consensus.cc:3060] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:20.982915 28666 tablet_bootstrap.cc:492] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:20.988610 28666 tablet_bootstrap.cc:654] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:20.989650 29435 raft_consensus.cc:2243] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:20.990981 29435 raft_consensus.cc:2272] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:20.992401 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15ae22ba5d46c09b1cc9d99dce8b38" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:20.993008 28499 raft_consensus.cc:2468] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:20.989544 29381 consensus_queue.cc:1048] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:20.995985 29435 ts_tablet_manager.cc:1916] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:21.004365 29417 leader_election.cc:290] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:21.020687 29376 raft_consensus.cc:493] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:21.020869 28666 tablet_bootstrap.cc:492] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:21.021279 28666 ts_tablet_manager.cc:1403] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.008s
I20260928 07:56:21.021152 29376 raft_consensus.cc:515] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } }
I20260928 07:56:21.023428 29376 leader_election.cc:290] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:21.024103 28666 raft_consensus.cc:359] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.024722 28666 raft_consensus.cc:385] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:21.024984 28666 raft_consensus.cc:740] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:21.027730 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41352cf9a4974e2b861d2234d9a5accd" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:21.029151 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41352cf9a4974e2b861d2234d9a5accd" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:21.034456 28666 consensus_queue.cc:260] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.037518 28434 leader_election.cc:304] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:21.038724 28499 raft_consensus.cc:3060] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:21.049369 28666 ts_tablet_manager.cc:1434] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260928 07:56:21.096307 29435 ts_tablet_manager.cc:1929] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:21.101570 29435 log.cc:1199] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/9b6fa66d29ca41b0b0d7ad8f30596aab
I20260928 07:56:21.104718 29435 ts_tablet_manager.cc:1950] T 9b6fa66d29ca41b0b0d7ad8f30596aab P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:21.108376 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 9b6fa66d29ca41b0b0d7ad8f30596aab (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
I20260928 07:56:21.127077 29439 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:21.128634 29439 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:21.130637 27828 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 138) took 2793 ms. Trace:
I20260928 07:56:21.132347 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 237 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:21.133661 29439 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:56:21.130993 27828 rpcz_store.cc:276] 0928 07:56:18.336998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.355660 (+ 18662us) service_pool.cc:224] Handling call
0928 07:56:18.589869 (+234209us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:18.591449 (+ 1580us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:20.971119 (+2379670us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:21.129944 (+158825us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:21.130309 (+ 365us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:21.130574 (+ 265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:20.972906 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:20.973306 (+ 400us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:20.973331 (+ 25us) write_op.cc:435] Acquired schema lock
0928 07:56:20.973343 (+ 12us) tablet.cc:662] Decoding operations
0928 07:56:20.973586 (+ 243us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:20.973635 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:20.973658 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:20.973851 (+ 193us) tablet.cc:701] Row locks acquired
0928 07:56:20.973864 (+ 13us) write_op.cc:260] PREPARE: finished
0928 07:56:20.973971 (+ 107us) write_op.cc:270] Start()
0928 07:56:20.974045 (+ 74us) write_op.cc:276] Timestamp: P: 1790582180973885 usec, L: 0
0928 07:56:20.974059 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 07:56:20.974504 (+ 445us) log.cc:844] Serialized 433 byte log entry
0928 07:56:21.117276 (+142772us) op_driver.cc:464] REPLICATION: finished
0928 07:56:21.117733 (+ 457us) write_op.cc:301] APPLY: starting
0928 07:56:21.117811 (+ 78us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:21.117962 (+ 151us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:21.118074 (+ 112us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:21.118530 (+ 456us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:21.118748 (+ 218us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:21.118813 (+ 65us) write_op.cc:312] APPLY: finished
0928 07:56:21.119441 (+ 628us) log.cc:844] Serialized 29 byte log entry
0928 07:56:21.119632 (+ 191us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:21.119725 (+ 93us) write_op.cc:454] Released schema lock
0928 07:56:21.119770 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":2215940,"Hive Metastore.run_cpu_time_us":652,"Hive Metastore.run_wall_time_us":163035,"child_traces":[["op",{"apply.queue_time_us":256,"num_ops":2,"prepare.queue_time_us":271,"prepare.run_cpu_time_us":1797,"prepare.run_wall_time_us":1797,"replication_time_us":143065}]]}
I20260928 07:56:21.141920 29414 raft_consensus.cc:493] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:21.142521 29414 raft_consensus.cc:515] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.144750 29414 leader_election.cc:290] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:21.147878 27913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 237 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:56:21.148391 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe80328a63344f78528b8537b3dbf0c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:21.148964 28494 raft_consensus.cc:2468] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:21.149523 29132 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16; no voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:56:21.151315 29439 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 07:56:21.146890 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe80328a63344f78528b8537b3dbf0c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:21.152379 28207 raft_consensus.cc:2468] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:21.153065 28285 leader_election.cc:304] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:21.154982 29417 raft_consensus.cc:2804] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:21.155391 29417 raft_consensus.cc:493] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:21.155928 29417 raft_consensus.cc:3060] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:21.169972 29376 raft_consensus.cc:2749] T 41352cf9a4974e2b861d2234d9a5accd P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:21.013072 29416 raft_consensus.cc:515] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.191639 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15ae22ba5d46c09b1cc9d99dce8b38" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:21.192615 28207 raft_consensus.cc:3060] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:21.202823 28207 raft_consensus.cc:2468] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:21.205629 29436 tablet_replica.cc:333] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:21.207427 29436 raft_consensus.cc:2243] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:21.209697 27827 catalog_manager.cc:6934] ReplaceTablet: tablet 9b6fa66d29ca41b0b0d7ad8f30596aab deleted and replaced by tablet 62bc065c9f2743c9ae79dc37bc6de0c2
I20260928 07:56:21.210353 27827 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51542 (request call id 148) took 2097 ms. Trace:
I20260928 07:56:21.210721 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b6fa66d29ca41b0b0d7ad8f30596aab with delete_type TABLET_DATA_DELETED (replaced by tablet 62bc065c9f2743c9ae79dc37bc6de0c2) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:21.214239 29433 tablet.cc:1751] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:21.238190 28286 leader_election.cc:304] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:21.239236 29414 raft_consensus.cc:2804] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:21.242276 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 2de0f3ba82a4442588cbb547f3cf9881 (DEFAULT_TABLE table=default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:21.243328 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de0f3ba82a4442588cbb547f3cf9881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:21.243148 29414 raft_consensus.cc:697] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:21.245079 29414 consensus_queue.cc:237] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.255693 29381 consensus_queue.cc:1048] T 41352cf9a4974e2b861d2234d9a5accd P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:21.256289 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 2de0f3ba82a4442588cbb547f3cf9881 (DEFAULT_TABLE table=default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:21.257450 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 2de0f3ba82a4442588cbb547f3cf9881 (DEFAULT_TABLE table=default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:21.258126 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de0f3ba82a4442588cbb547f3cf9881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:21.258483 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de0f3ba82a4442588cbb547f3cf9881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:21.271166 28493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15ae22ba5d46c09b1cc9d99dce8b38" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:21.271584 29440 tablet_replica.cc:333] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:21.271942 28493 raft_consensus.cc:3060] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:21.272498 29440 raft_consensus.cc:2243] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:21.272984 29440 raft_consensus.cc:2272] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:21.274675 29416 leader_election.cc:290] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:21.274926 29440 ts_tablet_manager.cc:1916] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:21.306653 27823 catalog_manager.cc:5838] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:21.314989 28666 tablet_bootstrap.cc:492] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:21.320899 28666 tablet_bootstrap.cc:654] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:21.328567 28493 raft_consensus.cc:2468] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:21.232388 29432 tablet.cc:1751] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:21.354322 27824 master_service.cc:960] ReplaceTablet: received request to replace tablet 11be687831574f5c961f703b03ce2c68 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:21.356201 28666 tablet_bootstrap.cc:492] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:21.356696 28666 ts_tablet_manager.cc:1403] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.042s user 0.012s sys 0.000s
I20260928 07:56:21.359323 28666 raft_consensus.cc:359] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:21.359952 28666 raft_consensus.cc:385] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:21.360183 28666 raft_consensus.cc:740] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:21.363474 29376 consensus_queue.cc:1048] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:21.383700 28666 consensus_queue.cc:260] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:21.399950 28351 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.551s user 0.008s sys 0.006s
W20260928 07:56:21.409588 28351 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.561s user 0.008s sys 0.006s
I20260928 07:56:21.411556 28666 ts_tablet_manager.cc:1434] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.055s user 0.004s sys 0.006s
I20260928 07:56:21.432425 29440 ts_tablet_manager.cc:1929] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:21.451398 29440 log.cc:1199] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/9b6fa66d29ca41b0b0d7ad8f30596aab
I20260928 07:56:21.453709 29440 ts_tablet_manager.cc:1950] T 9b6fa66d29ca41b0b0d7ad8f30596aab P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:21.210875 27827 rpcz_store.cc:276] 0928 07:56:19.113274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:20.791955 (+1678681us) service_pool.cc:224] Handling call
0928 07:56:20.927018 (+135063us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:20.927044 (+ 26us) write_op.cc:454] Released schema lock
0928 07:56:21.210265 (+283221us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:20.900928 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:20.901373 (+ 445us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:20.901402 (+ 29us) write_op.cc:435] Acquired schema lock
0928 07:56:20.901418 (+ 16us) tablet.cc:662] Decoding operations
0928 07:56:20.901723 (+ 305us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:20.901762 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:20.901783 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:20.901983 (+ 200us) tablet.cc:701] Row locks acquired
0928 07:56:20.901998 (+ 15us) write_op.cc:260] PREPARE: finished
0928 07:56:20.902108 (+ 110us) write_op.cc:270] Start()
0928 07:56:20.902211 (+ 103us) write_op.cc:276] Timestamp: P: 1790582180902028 usec, L: 0
0928 07:56:20.902226 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 07:56:20.902704 (+ 478us) log.cc:844] Serialized 665 byte log entry
0928 07:56:20.917168 (+ 14464us) op_driver.cc:464] REPLICATION: finished
0928 07:56:20.917705 (+ 537us) write_op.cc:301] APPLY: starting
0928 07:56:20.917764 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:20.917875 (+ 111us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:20.917988 (+ 113us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:20.918352 (+ 364us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:20.918558 (+ 206us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 07:56:20.918602 (+ 44us) write_op.cc:312] APPLY: finished
0928 07:56:20.918848 (+ 246us) log.cc:844] Serialized 29 byte log entry
0928 07:56:20.918996 (+ 148us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:20.919064 (+ 68us) write_op.cc:454] Released schema lock
0928 07:56:20.919094 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":357,"apply.run_cpu_time_us":1564,"apply.run_wall_time_us":1598,"num_ops":2,"prepare.queue_time_us":223,"prepare.run_cpu_time_us":2106,"prepare.run_wall_time_us":4473,"raft.queue_time_us":104,"raft.run_cpu_time_us":673,"raft.run_wall_time_us":672,"replication_time_us":14838}]]}
I20260928 07:56:21.463145 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 9b6fa66d29ca41b0b0d7ad8f30596aab (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
I20260928 07:56:21.455483 28499 raft_consensus.cc:3060] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:21.541630 29376 consensus_queue.cc:1048] T d139c0b8379446dfba037e96e0501a0b P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:21.558578 27824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet 11be687831574f5c961f703b03ce2c68
W20260928 07:56:21.579061 28285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 240944us
I20260928 07:56:21.611438 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 11be687831574f5c961f703b03ce2c68 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c670de5690141bea18b9a07d1e950d4) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:21.460645 27827 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_e54258c46322425fad34e060fa60546a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:21.560526 27828 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_e67f035c8fbf43c4ab59b6f0c127d5a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:21.635535 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 34a0cf784aee4d0e9b7b269182ba7de3 (DEFAULT_TABLE table=default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:21.636762 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a0cf784aee4d0e9b7b269182ba7de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:21.650455 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 11be687831574f5c961f703b03ce2c68 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c670de5690141bea18b9a07d1e950d4) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:21.654291 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 11be687831574f5c961f703b03ce2c68 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c670de5690141bea18b9a07d1e950d4) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:21.655766 29440 tablet_replica.cc:333] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:21.656677 29440 raft_consensus.cc:2243] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:21.657192 29440 raft_consensus.cc:2272] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:21.669139 29419 catalog_manager.cc:1308] Loaded cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:56:21.676195 29419 catalog_manager.cc:1601] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: loading cluster ID for follower catalog manager: success
I20260928 07:56:21.710817 29436 raft_consensus.cc:2272] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:21.713121 29436 ts_tablet_manager.cc:1916] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:21.715010 29443 consensus_queue.cc:1048] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:21.721305 29443 consensus_queue.cc:1048] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 07:56:21.723203 29417 consensus_meta.cc:287] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent flushing consensus metadata: real 0.567s user 0.012s sys 0.000s
I20260928 07:56:21.723573 29417 raft_consensus.cc:515] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.728950 29417 leader_election.cc:290] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:21.733886 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe80328a63344f78528b8537b3dbf0c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:21.734627 28207 raft_consensus.cc:3060] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:21.747612 28207 raft_consensus.cc:2468] T 8fe80328a63344f78528b8537b3dbf0c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:21.753885 29454 tablet_bootstrap.cc:492] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:21.764605 27824 catalog_manager.cc:6934] ReplaceTablet: tablet 11be687831574f5c961f703b03ce2c68 deleted and replaced by tablet 5c670de5690141bea18b9a07d1e950d4
I20260928 07:56:21.765377 27824 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51542 (request call id 149) took 1618 ms. Trace:
I20260928 07:56:21.772399 29452 tablet_replica.cc:333] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:21.771716 28286 leader_election.cc:304] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:21.773531 29417 raft_consensus.cc:2804] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:21.773727 29452 raft_consensus.cc:2243] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:21.774009 29417 raft_consensus.cc:697] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:21.774793 29417 consensus_queue.cc:237] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.809891 29419 catalog_manager.cc:1623] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: acquiring CA information for follower catalog manager: success
I20260928 07:56:21.819356 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 34a0cf784aee4d0e9b7b269182ba7de3 (DEFAULT_TABLE table=default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:21.823058 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a0cf784aee4d0e9b7b269182ba7de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:21.831125 29460 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:21.832001 29460 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:21.836608 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 237 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:21.847954 27913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 237 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:56:21.848313 29460 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:56:21.849895 29132 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16; no voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:56:21.868247 29461 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 07:56:21.879573 28285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 159445us
I20260928 07:56:21.880061 29376 raft_consensus.cc:493] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:21.880518 29376 raft_consensus.cc:515] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.881587 28498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fe80328a63344f78528b8537b3dbf0c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:21.882179 28498 raft_consensus.cc:3060] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:21.884352 29376 leader_election.cc:290] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:21.890864 28498 raft_consensus.cc:2468] T 8fe80328a63344f78528b8537b3dbf0c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:21.903007 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5a4815e0004b5e827e30ccbe9073f1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:21.909471 28350 raft_consensus.cc:2468] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:21.915091 28434 leader_election.cc:304] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:21.916126 29376 raft_consensus.cc:2804] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 07:56:21.916551 29376 raft_consensus.cc:493] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:21.917029 29376 raft_consensus.cc:3060] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Advancing to term 2
I20260928 07:56:21.924782 29452 raft_consensus.cc:2272] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:21.930045 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 34a0cf784aee4d0e9b7b269182ba7de3 (DEFAULT_TABLE table=default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:21.931232 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a0cf784aee4d0e9b7b269182ba7de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:21.941308 29448 raft_consensus.cc:493] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:21.941810 29448 raft_consensus.cc:515] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:21.943799 29448 leader_election.cc:290] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:21.950929 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5a4815e0004b5e827e30ccbe9073f1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:21.954155 28434 leader_election.cc:343] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Not found: Tablet not found: 2de0f3ba82a4442588cbb547f3cf9881
I20260928 07:56:21.961396 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de0f3ba82a4442588cbb547f3cf9881" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:21.963155 28434 leader_election.cc:343] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:21.964311 28434 leader_election.cc:304] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:21.965448 29448 raft_consensus.cc:2749] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:21.972592 29381 consensus_queue.cc:1048] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:21.974213 29376 raft_consensus.cc:515] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:21.975885 28494 raft_consensus.cc:1240] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 2 FOLLOWER]: Rejecting Update request from peer acdaa3cf2ffd45f5b55a169c1bacead5 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 07:56:21.976167 29376 leader_election.cc:290] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 2 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:21.977932 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5a4815e0004b5e827e30ccbe9073f1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:21.977979 29381 consensus_queue.cc:1059] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:21.978173 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5a4815e0004b5e827e30ccbe9073f1" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:21.978456 28350 raft_consensus.cc:3060] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Advancing to term 2
I20260928 07:56:21.980301 29465 raft_consensus.cc:3055] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 07:56:21.980643 29465 raft_consensus.cc:740] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:21.765787 27824 rpcz_store.cc:276] 0928 07:56:20.146596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:21.351970 (+1205374us) service_pool.cc:224] Handling call
0928 07:56:21.557649 (+205679us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:21.557678 (+ 29us) write_op.cc:454] Released schema lock
0928 07:56:21.765294 (+207616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:21.505235 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:21.505645 (+ 410us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:21.505670 (+ 25us) write_op.cc:435] Acquired schema lock
0928 07:56:21.505689 (+ 19us) tablet.cc:662] Decoding operations
0928 07:56:21.506046 (+ 357us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:21.506099 (+ 53us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:21.506132 (+ 33us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:21.506392 (+ 260us) tablet.cc:701] Row locks acquired
0928 07:56:21.506411 (+ 19us) write_op.cc:260] PREPARE: finished
0928 07:56:21.506539 (+ 128us) write_op.cc:270] Start()
0928 07:56:21.506640 (+ 101us) write_op.cc:276] Timestamp: P: 1790582181506500 usec, L: 0
0928 07:56:21.506661 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 07:56:21.507263 (+ 602us) log.cc:844] Serialized 665 byte log entry
0928 07:56:21.517646 (+ 10383us) op_driver.cc:464] REPLICATION: finished
0928 07:56:21.517993 (+ 347us) write_op.cc:301] APPLY: starting
0928 07:56:21.518062 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:21.518213 (+ 151us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:21.518386 (+ 173us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:21.518774 (+ 388us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:21.519035 (+ 261us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 07:56:21.519096 (+ 61us) write_op.cc:312] APPLY: finished
0928 07:56:21.519347 (+ 251us) log.cc:844] Serialized 29 byte log entry
0928 07:56:21.519525 (+ 178us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:21.519599 (+ 74us) write_op.cc:454] Released schema lock
0928 07:56:21.519630 (+ 31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":186,"apply.run_cpu_time_us":1811,"apply.run_wall_time_us":1811,"num_ops":2,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2382,"prepare.run_wall_time_us":2383,"raft.queue_time_us":211,"raft.run_cpu_time_us":852,"raft.run_wall_time_us":851,"replication_time_us":10867}]]}
I20260928 07:56:21.986342 29419 catalog_manager.cc:1651] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 07:56:21.989020 29381 consensus_queue.cc:1048] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:21.994059 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 62bc065c9f2743c9ae79dc37bc6de0c2 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:21.995169 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bc065c9f2743c9ae79dc37bc6de0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:22.003268 29465 consensus_queue.cc:260] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.025876 29454 tablet_bootstrap.cc:654] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.030973 29464 tablet_bootstrap.cc:492] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:22.036774 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 62bc065c9f2743c9ae79dc37bc6de0c2 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:22.037309 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 62bc065c9f2743c9ae79dc37bc6de0c2 (DEFAULT_TABLE table=default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:22.037844 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bc065c9f2743c9ae79dc37bc6de0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:22.038407 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bc065c9f2743c9ae79dc37bc6de0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:22.039805 29465 raft_consensus.cc:3060] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Advancing to term 2
I20260928 07:56:22.042630 29452 ts_tablet_manager.cc:1916] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:22.060441 29436 ts_tablet_manager.cc:1929] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:22.060878 29436 log.cc:1199] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/9b6fa66d29ca41b0b0d7ad8f30596aab
I20260928 07:56:22.121606 29440 ts_tablet_manager.cc:1916] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:22.122792 29454 tablet_bootstrap.cc:492] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:22.123296 29454 ts_tablet_manager.cc:1403] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.370s user 0.008s sys 0.004s
I20260928 07:56:22.130129 29467 tablet_bootstrap.cc:492] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:22.142496 29436 ts_tablet_manager.cc:1950] T 9b6fa66d29ca41b0b0d7ad8f30596aab P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:22.158084 29470 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:22.158937 29470 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:22.162796 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 267 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:22.169924 29436 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 187) took 1197 ms. Trace:
I20260928 07:56:22.174899 29464 tablet_bootstrap.cc:654] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.144564 28350 raft_consensus.cc:2468] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 2.
I20260928 07:56:22.180572 28434 leader_election.cc:304] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:22.181888 29376 raft_consensus.cc:2804] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 2 FOLLOWER]: Leader election won for term 2
I20260928 07:56:22.183234 29376 raft_consensus.cc:697] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [term 2 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:22.184293 29376 consensus_queue.cc:237] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.220180 29454 raft_consensus.cc:359] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.249583 29467 tablet_bootstrap.cc:654] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.223088 29470 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:22.253321 29454 raft_consensus.cc:385] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:22.253774 29454 raft_consensus.cc:740] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:22.254715 29454 consensus_queue.cc:260] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.261852 29454 ts_tablet_manager.cc:1434] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.138s user 0.008s sys 0.000s
I20260928 07:56:22.270965 29452 ts_tablet_manager.cc:1929] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:22.277570 29452 log.cc:1199] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/11be687831574f5c961f703b03ce2c68
I20260928 07:56:22.279532 29452 ts_tablet_manager.cc:1950] T 11be687831574f5c961f703b03ce2c68 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:22.280606 29440 ts_tablet_manager.cc:1929] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:22.281207 29440 log.cc:1199] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/11be687831574f5c961f703b03ce2c68
W20260928 07:56:22.282737 28089 hms_client.cc:335] Time spent create HMS table: real 1.312s user 0.000s sys 0.000s
I20260928 07:56:22.283528 27826 catalog_manager.cc:2213] created HMS catalog entry for table [id=8e3317b33e604a2b85b826a836bb8765]
I20260928 07:56:22.290940 29464 tablet_bootstrap.cc:492] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:22.291823 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:22.292721 29464 ts_tablet_manager.cc:1403] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.262s user 0.012s sys 0.000s
I20260928 07:56:22.170411 29436 rpcz_store.cc:276] 0928 07:56:20.972171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:20.972333 (+ 162us) service_pool.cc:224] Handling call
0928 07:56:21.205355 (+233022us) ts_tablet_manager.cc:1151] Deleting tablet 9b6fa66d29ca41b0b0d7ad8f30596aab
0928 07:56:21.205433 (+ 78us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:21.730689 (+525256us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:22.060307 (+329618us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:22.169845 (+109538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17447,"tablet-delete.queue_time_us":232376,"thread_start_us":233190,"threads_started":1}
I20260928 07:56:22.299551 29436 tablet_replica.cc:333] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:22.301163 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 9b6fa66d29ca41b0b0d7ad8f30596aab (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]) successfully deleted
I20260928 07:56:22.282100 29440 ts_tablet_manager.cc:1950] T 11be687831574f5c961f703b03ce2c68 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:22.300309 29454 tablet_bootstrap.cc:492] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:22.303897 27824 catalog_manager.cc:5838] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:22.306464 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 5c670de5690141bea18b9a07d1e950d4 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:22.303323 29467 tablet_bootstrap.cc:492] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:22.308198 29467 ts_tablet_manager.cc:1403] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.178s user 0.006s sys 0.006s
I20260928 07:56:22.309167 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:22.307471 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 5c670de5690141bea18b9a07d1e950d4 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:22.310894 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c670de5690141bea18b9a07d1e950d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:22.311137 29467 raft_consensus.cc:359] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.311775 29467 raft_consensus.cc:385] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:22.312073 29467 raft_consensus.cc:740] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:22.300439 29436 raft_consensus.cc:2243] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:22.313526 29436 raft_consensus.cc:2272] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:22.316603 29436 ts_tablet_manager.cc:1916] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:22.329644 27824 catalog_manager.cc:5838] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:22.338243 29454 tablet_bootstrap.cc:654] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.338948 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c670de5690141bea18b9a07d1e950d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:22.342159 27826 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 130) took 5899 ms. Trace:
I20260928 07:56:22.312758 29467 consensus_queue.cc:260] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.345031 29467 ts_tablet_manager.cc:1434] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
I20260928 07:56:22.342574 27826 rpcz_store.cc:276] 0928 07:56:16.443030 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:16.520292 (+ 77262us) service_pool.cc:224] Handling call
0928 07:56:18.579736 (+2059444us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:18.604085 (+ 24349us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:22.283486 (+3679401us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:22.341368 (+ 57882us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:22.341741 (+ 373us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:22.342075 (+ 334us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:22.285345 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:22.285841 (+ 496us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:22.285870 (+ 29us) write_op.cc:435] Acquired schema lock
0928 07:56:22.285885 (+ 15us) tablet.cc:662] Decoding operations
0928 07:56:22.286181 (+ 296us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:22.286219 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:22.286251 (+ 32us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:22.286511 (+ 260us) tablet.cc:701] Row locks acquired
0928 07:56:22.286528 (+ 17us) write_op.cc:260] PREPARE: finished
0928 07:56:22.286664 (+ 136us) write_op.cc:270] Start()
0928 07:56:22.286756 (+ 92us) write_op.cc:276] Timestamp: P: 1790582182286592 usec, L: 0
0928 07:56:22.286775 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 07:56:22.315689 (+ 28914us) log.cc:844] Serialized 433 byte log entry
0928 07:56:22.316384 (+ 695us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b54000203d4. stack: 00007f6ecc595323 00007f6ecc595220 00007f6ecc139574 0000000000516964 00000000005168f9 00007f6ed3692aa1 00007f6ed37255e8 00007f6ed3bb5791 00007f6ed3bb4f68 00007f6ed3bb9c01 00007f6ed3bb9bb9 00007f6ed3bb9b49 00007f6ed3bb9b11 00007f6ed3bb8d3d 00000000005bd4e4 00000000005bd319
0928 07:56:22.338747 (+ 22363us) op_driver.cc:464] REPLICATION: finished
0928 07:56:22.338994 (+ 247us) write_op.cc:301] APPLY: starting
0928 07:56:22.339052 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:22.339185 (+ 133us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:22.339204 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:22.339745 (+ 541us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:22.339932 (+ 187us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:22.340001 (+ 69us) write_op.cc:312] APPLY: finished
0928 07:56:22.340203 (+ 202us) log.cc:844] Serialized 29 byte log entry
0928 07:56:22.340372 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:22.340435 (+ 63us) write_op.cc:454] Released schema lock
0928 07:56:22.340466 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:22.340682 (+ 216us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:22.340713 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2366431,"Hive Metastore.run_cpu_time_us":976,"Hive Metastore.run_wall_time_us":1312120,"child_traces":[["op",{"apply.queue_time_us":100,"apply.run_cpu_time_us":1651,"apply.run_wall_time_us":1651,"num_ops":2,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":3379,"prepare.run_wall_time_us":31371,"raft.queue_time_us":4338,"raft.run_cpu_time_us":812,"raft.run_wall_time_us":812,"replication_time_us":51876,"spinlock_wait_cycles":65282816}]]}
I20260928 07:56:22.351133 27826 master_service.cc:960] ReplaceTablet: received request to replace tablet c213348428a04c479f871d390b7e3c95 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:22.355159 29467 tablet_bootstrap.cc:492] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:22.358726 29376 raft_consensus.cc:493] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:22.359299 29376 raft_consensus.cc:515] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.365432 29414 consensus_queue.cc:1048] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:22.383380 29234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 267 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:56:22.384183 29234 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f95afb2252e047ff9f5427a1cd7c0df0 in term 4.
I20260928 07:56:22.385715 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, f95afb2252e047ff9f5427a1cd7c0df0; no voters: dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:22.387085 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a0cf784aee4d0e9b7b269182ba7de3" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:22.388587 28434 leader_election.cc:343] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:22.390376 29376 leader_election.cc:290] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:22.390731 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a0cf784aee4d0e9b7b269182ba7de3" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
W20260928 07:56:22.392086 28434 leader_election.cc:343] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:22.392505 28434 leader_election.cc:304] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:22.394356 29467 tablet_bootstrap.cc:654] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.395032 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 5c670de5690141bea18b9a07d1e950d4 (DEFAULT_TABLE table=default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:22.401053 29376 raft_consensus.cc:2749] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:22.408847 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c670de5690141bea18b9a07d1e950d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:22.421538 29414 consensus_queue.cc:1048] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:22.426326 29467 tablet_bootstrap.cc:492] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:22.428020 29467 ts_tablet_manager.cc:1403] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.073s user 0.009s sys 0.002s
I20260928 07:56:22.440455 29467 raft_consensus.cc:359] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.295930 29464 raft_consensus.cc:359] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.443290 29464 raft_consensus.cc:385] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:22.443813 29464 raft_consensus.cc:740] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:22.444679 29464 consensus_queue.cc:260] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.445519 29467 raft_consensus.cc:385] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:22.447002 29467 raft_consensus.cc:740] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:22.459043 29467 consensus_queue.cc:260] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.467162 29467 ts_tablet_manager.cc:1434] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.033s user 0.004s sys 0.001s
I20260928 07:56:22.476612 29470 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 07:56:22.478330 29470 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:22.478890 29470 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 4 FOLLOWER]: Advancing to term 5
I20260928 07:56:22.499514 29470 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:22.501003 27912 raft_consensus.cc:1240] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 5 FOLLOWER]: Rejecting Update request from peer dfb6604d9ebb423090c878c2b1db0cab for earlier term 4. Current term is 5. Ops: [4.271-4.272]
I20260928 07:56:22.505573 29479 consensus_queue.cc:1059] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 }, Status: INVALID_TERM, Last received: 4.270, Next index: 271, Last known committed idx: 270, Time since last communication: 0.001s
I20260928 07:56:22.506556 29483 raft_consensus.cc:3055] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 4 LEADER]: Stepping down as leader of term 4
I20260928 07:56:22.506956 29483 raft_consensus.cc:740] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dfb6604d9ebb423090c878c2b1db0cab, State: Running, Role: LEADER
I20260928 07:56:22.507798 29483 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 270, Committed index: 270, Last appended: 4.272, Last appended by leader: 272, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:22.508961 29483 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 4 FOLLOWER]: Advancing to term 5
I20260928 07:56:22.514786 29443 raft_consensus.cc:493] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:22.515251 29443 raft_consensus.cc:515] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.520557 29443 leader_election.cc:290] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:22.521800 28205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de0f3ba82a4442588cbb547f3cf9881" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:22.522578 28205 raft_consensus.cc:2468] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:22.523850 28286 leader_election.cc:304] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:22.524921 29443 raft_consensus.cc:2804] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:22.525367 29443 raft_consensus.cc:493] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:22.525767 29443 raft_consensus.cc:3060] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:22.533635 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de0f3ba82a4442588cbb547f3cf9881" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:22.534382 28499 raft_consensus.cc:2468] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:22.537662 29464 ts_tablet_manager.cc:1434] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.245s user 0.007s sys 0.000s
I20260928 07:56:22.538998 29464 tablet_bootstrap.cc:492] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:22.546916 29443 raft_consensus.cc:515] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.549820 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de0f3ba82a4442588cbb547f3cf9881" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:22.550587 28499 raft_consensus.cc:3060] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:22.556586 29417 consensus_queue.cc:1048] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:22.561864 28499 raft_consensus.cc:2468] T 2de0f3ba82a4442588cbb547f3cf9881 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:22.572540 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 270 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab"
I20260928 07:56:22.573536 27839 raft_consensus.cc:2410] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f95afb2252e047ff9f5427a1cd7c0df0 for term 5 because replica has last-logged OpId of term: 4 index: 272, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 270.
I20260928 07:56:22.576653 29234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 5 candidate_status { last_received { term: 4 index: 270 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16"
I20260928 07:56:22.577255 29234 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 4 FOLLOWER]: Advancing to term 5
I20260928 07:56:22.586540 29234 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f95afb2252e047ff9f5427a1cd7c0df0 in term 5.
I20260928 07:56:22.587807 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, f95afb2252e047ff9f5427a1cd7c0df0; no voters: dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:22.589104 29454 tablet_bootstrap.cc:492] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:22.589643 29454 ts_tablet_manager.cc:1403] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.290s user 0.020s sys 0.014s
I20260928 07:56:22.598239 29470 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 5 election: Requested vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:22.600895 29470 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 5 FOLLOWER]: Leader election won for term 5
I20260928 07:56:22.603305 29470 raft_consensus.cc:697] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 5 LEADER]: Becoming Leader. State: Replica: f95afb2252e047ff9f5427a1cd7c0df0, State: Running, Role: LEADER
I20260928 07:56:22.626669 29417 consensus_queue.cc:1048] T 8fe80328a63344f78528b8537b3dbf0c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:22.638677 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de0f3ba82a4442588cbb547f3cf9881" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:22.639410 28204 raft_consensus.cc:3060] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:22.651120 28204 raft_consensus.cc:2468] T 2de0f3ba82a4442588cbb547f3cf9881 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:22.661867 29443 leader_election.cc:290] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039)
I20260928 07:56:22.663008 29470 consensus_queue.cc:237] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 270, Committed index: 270, Last appended: 4.270, Last appended by leader: 270, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:22.632161 29467 tablet_bootstrap.cc:492] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:22.672649 29467 tablet_bootstrap.cc:654] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.675487 29454 raft_consensus.cc:359] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.676218 29454 raft_consensus.cc:385] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:22.690097 29464 tablet_bootstrap.cc:654] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.708022 29492 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f95afb2252e047ff9f5427a1cd7c0df0. Latest consensus state: current_term: 5 leader_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:22.709945 29492 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: LEADER
I20260928 07:56:22.676426 28285 leader_election.cc:304] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:22.715161 29417 raft_consensus.cc:2804] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:22.715641 29417 raft_consensus.cc:697] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:22.716473 29417 consensus_queue.cc:237] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
W20260928 07:56:22.719511 27813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 07:56:22.719179 29436 ts_tablet_manager.cc:1929] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:22.720315 29436 log.cc:1199] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/11be687831574f5c961f703b03ce2c68
I20260928 07:56:22.721318 29436 ts_tablet_manager.cc:1950] T 11be687831574f5c961f703b03ce2c68 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:22.724149 29436 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60428 (request call id 189) took 1074 ms. Trace:
I20260928 07:56:22.730959 29496 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 07:56:22.736649 29467 tablet_bootstrap.cc:492] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:22.737262 29467 ts_tablet_manager.cc:1403] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.105s user 0.009s sys 0.004s
I20260928 07:56:22.758625 29464 tablet_bootstrap.cc:492] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:22.760360 29464 ts_tablet_manager.cc:1403] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.222s user 0.012s sys 0.000s
I20260928 07:56:22.763048 29467 raft_consensus.cc:359] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.676497 29454 raft_consensus.cc:740] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:20.478152 29238 rpcz_store.cc:276] 0928 07:56:18.262522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.262644 (+ 122us) service_pool.cc:224] Handling call
0928 07:56:19.060636 (+797992us) raft_consensus.cc:1471] Updating replica for 231 ops
0928 07:56:19.299971 (+239335us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 07:56:19.300030 (+ 59us) raft_consensus.cc:1539] Triggering prepare for 231 ops
0928 07:56:19.300835 (+ 805us) write_op.cc:270] Start()
0928 07:56:19.300999 (+ 164us) write_op.cc:276] Timestamp: P: 1790582158159171 usec, L: 0
0928 07:56:19.414229 (+113230us) write_op.cc:270] Start()
0928 07:56:19.414373 (+ 144us) write_op.cc:276] Timestamp: P: 1790582158274216 usec, L: 0
0928 07:56:19.415056 (+ 683us) write_op.cc:270] Start()
0928 07:56:19.415223 (+ 167us) write_op.cc:276] Timestamp: P: 1790582158315802 usec, L: 0
0928 07:56:19.415807 (+ 584us) write_op.cc:270] Start()
0928 07:56:19.415891 (+ 84us) write_op.cc:276] Timestamp: P: 1790582158410817 usec, L: 0
0928 07:56:19.416462 (+ 571us) write_op.cc:270] Start()
0928 07:56:19.416552 (+ 90us) write_op.cc:276] Timestamp: P: 1790582158464458 usec, L: 0
0928 07:56:19.417085 (+ 533us) write_op.cc:270] Start()
0928 07:56:19.417188 (+ 103us) write_op.cc:276] Timestamp: P: 1790582158527089 usec, L: 0
0928 07:56:19.454153 (+ 36965us) write_op.cc:270] Start()
0928 07:56:19.454414 (+ 261us) write_op.cc:276] Timestamp: P: 1790582158736039 usec, L: 0
0928 07:56:19.457459 (+ 3045us) write_op.cc:270] Start()
0928 07:56:19.457555 (+ 96us) write_op.cc:276] Timestamp: P: 1790582158770586 usec, L: 0
0928 07:56:19.458111 (+ 556us) write_op.cc:270] Start()
0928 07:56:19.458197 (+ 86us) write_op.cc:276] Timestamp: P: 1790582158796854 usec, L: 0
0928 07:56:19.458700 (+ 503us) write_op.cc:270] Start()
0928 07:56:19.458776 (+ 76us) write_op.cc:276] Timestamp: P: 1790582159408659 usec, L: 0
0928 07:56:19.459227 (+ 451us) write_op.cc:270] Start()
0928 07:56:19.459305 (+ 78us) write_op.cc:276] Timestamp: P: 1790582159497134 usec, L: 0
0928 07:56:19.459809 (+ 504us) write_op.cc:270] Start()
0928 07:56:19.459914 (+ 105us) write_op.cc:276] Timestamp: P: 1790582159532511 usec, L: 0
0928 07:56:19.493283 (+ 33369us) write_op.cc:270] Start()
0928 07:56:19.493424 (+ 141us) write_op.cc:276] Timestamp: P: 1790582159553836 usec, L: 0
0928 07:56:19.494090 (+ 666us) write_op.cc:270] Start()
0928 07:56:19.494174 (+ 84us) write_op.cc:276] Timestamp: P: 1790582159785472 usec, L: 0
0928 07:56:19.494743 (+ 569us) write_op.cc:270] Start()
0928 07:56:19.494819 (+ 76us) write_op.cc:276] Timestamp: P: 1790582159802303 usec, L: 0
0928 07:56:19.495279 (+ 460us) write_op.cc:270] Start()
0928 07:56:19.495357 (+ 78us) write_op.cc:276] Timestamp: P: 1790582159863217 usec, L: 0
0928 07:56:19.495852 (+ 495us) write_op.cc:270] Start()
0928 07:56:19.495936 (+ 84us) write_op.cc:276] Timestamp: P: 1790582160042881 usec, L: 0
0928 07:56:19.501350 (+ 5414us) write_op.cc:270] Start()
0928 07:56:19.501441 (+ 91us) write_op.cc:276] Timestamp: P: 1790582160077535 usec, L: 0
0928 07:56:19.502017 (+ 576us) write_op.cc:270] Start()
0928 07:56:19.502119 (+ 102us) write_op.cc:276] Timestamp: P: 1790582160234837 usec, L: 0
0928 07:56:19.507814 (+ 5695us) write_op.cc:270] Start()
0928 07:56:19.507935 (+ 121us) write_op.cc:276] Timestamp: P: 1790582160265289 usec, L: 0
0928 07:56:19.508493 (+ 558us) write_op.cc:270] Start()
0928 07:56:19.508579 (+ 86us) write_op.cc:276] Timestamp: P: 1790582160364456 usec, L: 0
0928 07:56:19.509108 (+ 529us) write_op.cc:270] Start()
0928 07:56:19.509192 (+ 84us) write_op.cc:276] Timestamp: P: 1790582160549657 usec, L: 0
0928 07:56:19.509688 (+ 496us) write_op.cc:270] Start()
0928 07:56:19.509761 (+ 73us) write_op.cc:276] Timestamp: P: 1790582160596904 usec, L: 0
0928 07:56:19.526035 (+ 16274us) write_op.cc:270] Start()
0928 07:56:19.526227 (+ 192us) write_op.cc:276] Timestamp: P: 1790582160890693 usec, L: 0
0928 07:56:19.527056 (+ 829us) write_op.cc:270] Start()
0928 07:56:19.527163 (+ 107us) write_op.cc:276] Timestamp: P: 1790582160900460 usec, L: 0
0928 07:56:19.527739 (+ 576us) write_op.cc:270] Start()
0928 07:56:19.527860 (+ 121us) write_op.cc:276] Timestamp: P: 1790582160931890 usec, L: 0
0928 07:56:19.528370 (+ 510us) write_op.cc:270] Start()
0928 07:56:19.528449 (+ 79us) write_op.cc:276] Timestamp: P: 1790582161005323 usec, L: 0
0928 07:56:19.529023 (+ 574us) write_op.cc:270] Start()
0928 07:56:19.529133 (+ 110us) write_op.cc:276] Timestamp: P: 1790582161128760 usec, L: 0
0928 07:56:19.544585 (+ 15452us) write_op.cc:270] Start()
0928 07:56:19.544709 (+ 124us) write_op.cc:276] Timestamp: P: 1790582161163372 usec, L: 0
0928 07:56:19.550054 (+ 5345us) write_op.cc:270] Start()
0928 07:56:19.550201 (+ 147us) write_op.cc:276] Timestamp: P: 1790582161205007 usec, L: 0
0928 07:56:19.550940 (+ 739us) write_op.cc:270] Start()
0928 07:56:19.551041 (+ 101us) write_op.cc:276] Timestamp: P: 1790582161281591 usec, L: 0
0928 07:56:19.551672 (+ 631us) write_op.cc:270] Start()
0928 07:56:19.551782 (+ 110us) write_op.cc:276] Timestamp: P: 1790582161432740 usec, L: 0
0928 07:56:19.552478 (+ 696us) write_op.cc:270] Start()
0928 07:56:19.552580 (+ 102us) write_op.cc:276] Timestamp: P: 1790582161511964 usec, L: 0
0928 07:56:19.570804 (+ 18224us) write_op.cc:270] Start()
0928 07:56:19.581096 (+ 10292us) write_op.cc:276] Timestamp: P: 1790582161681941 usec, L: 0
0928 07:56:19.581785 (+ 689us) write_op.cc:270] Start()
0928 07:56:19.581867 (+ 82us) write_op.cc:276] Timestamp: P: 1790582161723150 usec, L: 0
0928 07:56:19.582448 (+ 581us) write_op.cc:270] Start()
0928 07:56:19.582523 (+ 75us) write_op.cc:276] Timestamp: P: 1790582161752855 usec, L: 0
0928 07:56:19.582945 (+ 422us) write_op.cc:270] Start()
0928 07:56:19.583013 (+ 68us) write_op.cc:276] Timestamp: P: 1790582161855569 usec, L: 0
0928 07:56:19.583533 (+ 520us) write_op.cc:270] Start()
0928 07:56:19.583609 (+ 76us) write_op.cc:276] Timestamp: P: 1790582162074580 usec, L: 0
0928 07:56:19.584066 (+ 457us) write_op.cc:270] Start()
0928 07:56:19.584148 (+ 82us) write_op.cc:276] Timestamp: P: 1790582162141262 usec, L: 0
0928 07:56:19.584613 (+ 465us) write_op.cc:270] Start()
0928 07:56:19.584689 (+ 76us) write_op.cc:276] Timestamp: P: 1790582162178882 usec, L: 0
0928 07:56:19.585151 (+ 462us) write_op.cc:270] Start()
0928 07:56:19.589496 (+ 4345us) write_op.cc:276] Timestamp: P: 1790582162340720 usec, L: 0
0928 07:56:19.590084 (+ 588us) write_op.cc:270] Start()
0928 07:56:19.590170 (+ 86us) write_op.cc:276] Timestamp: P: 1790582162408976 usec, L: 0
0928 07:56:19.590742 (+ 572us) write_op.cc:270] Start()
0928 07:56:19.590826 (+ 84us) write_op.cc:276] Timestamp: P: 1790582162572546 usec, L: 0
0928 07:56:19.591370 (+ 544us) write_op.cc:270] Start()
0928 07:56:19.591461 (+ 91us) write_op.cc:276] Timestamp: P: 1790582162626348 usec, L: 0
0928 07:56:19.591989 (+ 528us) write_op.cc:270] Start()
0928 07:56:19.592067 (+ 78us) write_op.cc:276] Timestamp: P: 1790582162851142 usec, L: 0
0928 07:56:19.592515 (+ 448us) write_op.cc:270] Start()
0928 07:56:19.592596 (+ 81us) write_op.cc:276] Timestamp: P: 1790582162938895 usec, L: 0
0928 07:56:19.602819 (+ 10223us) write_op.cc:270] Start()
0928 07:56:19.602931 (+ 112us) write_op.cc:276] Timestamp: P: 1790582162974677 usec, L: 0
0928 07:56:19.603667 (+ 736us) write_op.cc:270] Start()
0928 07:56:19.603812 (+ 145us) write_op.cc:276] Timestamp: P: 1790582163064012 usec, L: 0
0928 07:56:19.604329 (+ 517us) write_op.cc:270] Start()
0928 07:56:19.604409 (+ 80us) write_op.cc:276] Timestamp: P: 1790582163088235 usec, L: 0
0928 07:56:19.604822 (+ 413us) write_op.cc:270] Start()
0928 07:56:19.604891 (+ 69us) write_op.cc:276] Timestamp: P: 1790582163147422 usec, L: 0
0928 07:56:19.609622 (+ 4731us) write_op.cc:270] Start()
0928 07:56:19.609735 (+ 113us) write_op.cc:276] Timestamp: P: 1790582163191234 usec, L: 0
0928 07:56:19.610324 (+ 589us) write_op.cc:270] Start()
0928 07:56:19.610427 (+ 103us) write_op.cc:276] Timestamp: P: 1790582163246881 usec, L: 0
0928 07:56:19.610938 (+ 511us) write_op.cc:270] Start()
0928 07:56:19.611033 (+ 95us) write_op.cc:276] Timestamp: P: 1790582163355097 usec, L: 0
0928 07:56:19.613778 (+ 2745us) write_op.cc:270] Start()
0928 07:56:19.613876 (+ 98us) write_op.cc:276] Timestamp: P: 1790582163433359 usec, L: 0
0928 07:56:19.615810 (+ 1934us) write_op.cc:270] Start()
0928 07:56:19.615912 (+ 102us) write_op.cc:276] Timestamp: P: 1790582163487351 usec, L: 0
0928 07:56:19.621634 (+ 5722us) write_op.cc:270] Start()
0928 07:56:19.621746 (+ 112us) write_op.cc:276] Timestamp: P: 1790582163534361 usec, L: 0
0928 07:56:19.622294 (+ 548us) write_op.cc:270] Start()
0928 07:56:19.622379 (+ 85us) write_op.cc:276] Timestamp: P: 1790582163562963 usec, L: 0
0928 07:56:19.622862 (+ 483us) write_op.cc:270] Start()
0928 07:56:19.622943 (+ 81us) write_op.cc:276] Timestamp: P: 1790582163598598 usec, L: 0
0928 07:56:19.623432 (+ 489us) write_op.cc:270] Start()
0928 07:56:19.623515 (+ 83us) write_op.cc:276] Timestamp: P: 1790582163635964 usec, L: 0
0928 07:56:19.624034 (+ 519us) write_op.cc:270] Start()
0928 07:56:19.627429 (+ 3395us) write_op.cc:276] Timestamp: P: 1790582163672585 usec, L: 0
0928 07:56:19.627987 (+ 558us) write_op.cc:270] Start()
0928 07:56:19.628070 (+ 83us) write_op.cc:276] Timestamp: P: 1790582163689496 usec, L: 0
0928 07:56:19.628527 (+ 457us) write_op.cc:270] Start()
0928 07:56:19.628606 (+ 79us) write_op.cc:276] Timestamp: P: 1790582163794880 usec, L: 0
0928 07:56:19.631638 (+ 3032us) write_op.cc:270] Start()
0928 07:56:19.631724 (+ 86us) write_op.cc:276] Timestamp: P: 1790582163812184 usec, L: 0
0928 07:56:19.632218 (+ 494us) write_op.cc:270] Start()
0928 07:56:19.632293 (+ 75us) write_op.cc:276] Timestamp: P: 1790582163948037 usec, L: 0
0928 07:56:19.634449 (+ 2156us) write_op.cc:270] Start()
0928 07:56:19.634533 (+ 84us) write_op.cc:276] Timestamp: P: 1790582164061270 usec, L: 0
0928 07:56:19.635021 (+ 488us) write_op.cc:270] Start()
0928 07:56:19.635099 (+ 78us) write_op.cc:276] Timestamp: P: 1790582164140225 usec, L: 0
0928 07:56:19.635565 (+ 466us) write_op.cc:270] Start()
0928 07:56:19.635644 (+ 79us) write_op.cc:276] Timestamp: P: 1790582164217813 usec, L: 0
0928 07:56:19.636073 (+ 429us) write_op.cc:270] Start()
0928 07:56:19.636145 (+ 72us) write_op.cc:276] Timestamp: P: 1790582164340130 usec, L: 0
0928 07:56:19.636571 (+ 426us) write_op.cc:270] Start()
0928 07:56:19.636639 (+ 68us) write_op.cc:276] Timestamp: P: 1790582164386083 usec, L: 0
0928 07:56:19.640074 (+ 3435us) write_op.cc:270] Start()
0928 07:56:19.640275 (+ 201us) write_op.cc:276] Timestamp: P: 1790582164432143 usec, L: 0
0928 07:56:19.640805 (+ 530us) write_op.cc:270] Start()
0928 07:56:19.640913 (+ 108us) write_op.cc:276] Timestamp: P: 1790582164494720 usec, L: 0
0928 07:56:19.641430 (+ 517us) write_op.cc:270] Start()
0928 07:56:19.641511 (+ 81us) write_op.cc:276] Timestamp: P: 1790582164679507 usec, L: 0
0928 07:56:19.641979 (+ 468us) write_op.cc:270] Start()
0928 07:56:19.642051 (+ 72us) write_op.cc:276] Timestamp: P: 1790582164900424 usec, L: 0
0928 07:56:19.642469 (+ 418us) write_op.cc:270] Start()
0928 07:56:19.642539 (+ 70us) write_op.cc:276] Timestamp: P: 1790582164933172 usec, L: 0
0928 07:56:19.642992 (+ 453us) write_op.cc:270] Start()
0928 07:56:19.643073 (+ 81us) write_op.cc:276] Timestamp: P: 1790582165010481 usec, L: 0
0928 07:56:19.643519 (+ 446us) write_op.cc:270] Start()
0928 07:56:19.643592 (+ 73us) write_op.cc:276] Timestamp: P: 1790582165067033 usec, L: 0
0928 07:56:19.649656 (+ 6064us) write_op.cc:270] Start()
0928 07:56:19.649773 (+ 117us) write_op.cc:276] Timestamp: P: 1790582165551346 usec, L: 0
0928 07:56:19.650389 (+ 616us) write_op.cc:270] Start()
0928 07:56:19.650476 (+ 87us) write_op.cc:276] Timestamp: P: 1790582165588555 usec, L: 0
0928 07:56:19.651002 (+ 526us) write_op.cc:270] Start()
0928 07:56:19.651085 (+ 83us) write_op.cc:276] Timestamp: P: 1790582165608492 usec, L: 0
0928 07:56:19.651566 (+ 481us) write_op.cc:270] Start()
0928 07:56:19.651647 (+ 81us) write_op.cc:276] Timestamp: P: 1790582165668179 usec, L: 0
0928 07:56:19.652123 (+ 476us) write_op.cc:270] Start()
0928 07:56:19.652201 (+ 78us) write_op.cc:276] Timestamp: P: 1790582165709705 usec, L: 0
0928 07:56:19.686453 (+ 34252us) write_op.cc:270] Start()
0928 07:56:19.686556 (+ 103us) write_op.cc:276] Timestamp: P: 1790582165746154 usec, L: 0
0928 07:56:19.687113 (+ 557us) write_op.cc:270] Start()
0928 07:56:19.687184 (+ 71us) write_op.cc:276] Timestamp: P: 1790582165840766 usec, L: 0
0928 07:56:19.687820 (+ 636us) write_op.cc:270] Start()
0928 07:56:19.687956 (+ 136us) write_op.cc:276] Timestamp: P: 1790582165907638 usec, L: 0
0928 07:56:19.692734 (+ 4778us) write_op.cc:270] Start()
0928 07:56:19.694075 (+ 1341us) write_op.cc:276] Timestamp: P: 1790582165967364 usec, L: 0
0928 07:56:19.694567 (+ 492us) write_op.cc:270] Start()
0928 07:56:19.694642 (+ 75us) write_op.cc:276] Timestamp: P: 1790582166039980 usec, L: 0
0928 07:56:19.695078 (+ 436us) write_op.cc:270] Start()
0928 07:56:19.695151 (+ 73us) write_op.cc:276] Timestamp: P: 1790582166064582 usec, L: 0
0928 07:56:19.695581 (+ 430us) write_op.cc:270] Start()
0928 07:56:19.695655 (+ 74us) write_op.cc:276] Timestamp: P: 1790582166132985 usec, L: 0
0928 07:56:19.696089 (+ 434us) write_op.cc:270] Start()
0928 07:56:19.696162 (+ 73us) write_op.cc:276] Timestamp: P: 1790582166197399 usec, L: 0
0928 07:56:19.696616 (+ 454us) write_op.cc:270] Start()
0928 07:56:19.696693 (+ 77us) write_op.cc:276] Timestamp: P: 1790582166272622 usec, L: 0
0928 07:56:19.697152 (+ 459us) write_op.cc:270] Start()
0928 07:56:19.706567 (+ 9415us) write_op.cc:276] Timestamp: P: 1790582166306772 usec, L: 0
0928 07:56:19.707208 (+ 641us) write_op.cc:270] Start()
0928 07:56:19.707302 (+ 94us) write_op.cc:276] Timestamp: P: 1790582166312617 usec, L: 0
0928 07:56:19.707806 (+ 504us) write_op.cc:270] Start()
0928 07:56:19.707885 (+ 79us) write_op.cc:276] Timestamp: P: 1790582166396009 usec, L: 0
0928 07:56:19.708325 (+ 440us) write_op.cc:270] Start()
0928 07:56:19.708397 (+ 72us) write_op.cc:276] Timestamp: P: 1790582166402899 usec, L: 0
0928 07:56:19.708819 (+ 422us) write_op.cc:270] Start()
0928 07:56:19.708918 (+ 99us) write_op.cc:276] Timestamp: P: 1790582166571204 usec, L: 0
0928 07:56:19.709512 (+ 594us) write_op.cc:270] Start()
0928 07:56:19.709594 (+ 82us) write_op.cc:276] Timestamp: P: 1790582166592233 usec, L: 0
0928 07:56:19.718114 (+ 8520us) write_op.cc:270] Start()
0928 07:56:19.718236 (+ 122us) write_op.cc:276] Timestamp: P: 1790582166643971 usec, L: 0
0928 07:56:19.720355 (+ 2119us) write_op.cc:270] Start()
0928 07:56:19.720574 (+ 219us) write_op.cc:276] Timestamp: P: 1790582166736195 usec, L: 0
0928 07:56:19.721240 (+ 666us) write_op.cc:270] Start()
0928 07:56:19.721320 (+ 80us) write_op.cc:276] Timestamp: P: 1790582166865715 usec, L: 0
0928 07:56:19.721795 (+ 475us) write_op.cc:270] Start()
0928 07:56:19.721871 (+ 76us) write_op.cc:276] Timestamp: P: 1790582167056511 usec, L: 0
0928 07:56:19.722364 (+ 493us) write_op.cc:270] Start()
0928 07:56:19.722456 (+ 92us) write_op.cc:276] Timestamp: P: 1790582167137026 usec, L: 0
0928 07:56:19.739952 (+ 17496us) write_op.cc:270] Start()
0928 07:56:19.740063 (+ 111us) write_op.cc:276] Timestamp: P: 1790582167244082 usec, L: 0
0928 07:56:19.740738 (+ 675us) write_op.cc:270] Start()
0928 07:56:19.740851 (+ 113us) write_op.cc:276] Timestamp: P: 1790582167433355 usec, L: 0
0928 07:56:19.741493 (+ 642us) write_op.cc:270] Start()
0928 07:56:19.741596 (+ 103us) write_op.cc:276] Timestamp: P: 1790582167460259 usec, L: 0
0928 07:56:19.742159 (+ 563us) write_op.cc:270] Start()
0928 07:56:19.742242 (+ 83us) write_op.cc:276] Timestamp: P: 1790582167525950 usec, L: 0
0928 07:56:19.742718 (+ 476us) write_op.cc:270] Start()
0928 07:56:19.742791 (+ 73us) write_op.cc:276] Timestamp: P: 1790582167592157 usec, L: 0
0928 07:56:19.743220 (+ 429us) write_op.cc:270] Start()
0928 07:56:19.743296 (+ 76us) write_op.cc:276] Timestamp: P: 1790582167602461 usec, L: 0
0928 07:56:19.743730 (+ 434us) write_op.cc:270] Start()
0928 07:56:19.743808 (+ 78us) write_op.cc:276] Timestamp: P: 1790582167642423 usec, L: 0
0928 07:56:19.754852 (+ 11044us) write_op.cc:270] Start()
0928 07:56:19.754943 (+ 91us) write_op.cc:276] Timestamp: P: 1790582167704105 usec, L: 0
0928 07:56:19.755412 (+ 469us) write_op.cc:270] Start()
0928 07:56:19.755489 (+ 77us) write_op.cc:276] Timestamp: P: 1790582167751230 usec, L: 0
0928 07:56:19.757666 (+ 2177us) write_op.cc:270] Start()
0928 07:56:19.757762 (+ 96us) write_op.cc:276] Timestamp: P: 1790582167808890 usec, L: 0
0928 07:56:19.758247 (+ 485us) write_op.cc:270] Start()
0928 07:56:19.758322 (+ 75us) write_op.cc:276] Timestamp: P: 1790582167939268 usec, L: 0
0928 07:56:19.758751 (+ 429us) write_op.cc:270] Start()
0928 07:56:19.758838 (+ 87us) write_op.cc:276] Timestamp: P: 1790582168054821 usec, L: 0
0928 07:56:19.759312 (+ 474us) write_op.cc:270] Start()
0928 07:56:19.759391 (+ 79us) write_op.cc:276] Timestamp: P: 1790582168176116 usec, L: 0
0928 07:56:19.759847 (+ 456us) write_op.cc:270] Start()
0928 07:56:19.759927 (+ 80us) write_op.cc:276] Timestamp: P: 1790582168231225 usec, L: 0
0928 07:56:19.760387 (+ 460us) write_op.cc:270] Start()
0928 07:56:19.760460 (+ 73us) write_op.cc:276] Timestamp: P: 1790582168264426 usec, L: 0
0928 07:56:19.760931 (+ 471us) write_op.cc:270] Start()
0928 07:56:19.761008 (+ 77us) write_op.cc:276] Timestamp: P: 1790582168448984 usec, L: 0
0928 07:56:19.867569 (+106561us) write_op.cc:270] Start()
0928 07:56:19.867730 (+ 161us) write_op.cc:276] Timestamp: P: 1790582168688165 usec, L: 0
0928 07:56:19.881500 (+ 13770us) write_op.cc:270] Start()
0928 07:56:19.881600 (+ 100us) write_op.cc:276] Timestamp: P: 1790582168697644 usec, L: 0
0928 07:56:19.882167 (+ 567us) write_op.cc:270] Start()
0928 07:56:19.887913 (+ 5746us) write_op.cc:276] Timestamp: P: 1790582168799583 usec, L: 0
0928 07:56:19.888554 (+ 641us) write_op.cc:270] Start()
0928 07:56:19.888645 (+ 91us) write_op.cc:276] Timestamp: P: 1790582168912175 usec, L: 0
0928 07:56:19.889147 (+ 502us) write_op.cc:270] Start()
0928 07:56:19.889245 (+ 98us) write_op.cc:276] Timestamp: P: 1790582169083640 usec, L: 0
0928 07:56:19.889693 (+ 448us) write_op.cc:270] Start()
0928 07:56:19.889766 (+ 73us) write_op.cc:276] Timestamp: P: 1790582169211288 usec, L: 0
0928 07:56:19.890313 (+ 547us) write_op.cc:270] Start()
0928 07:56:19.890393 (+ 80us) write_op.cc:276] Timestamp: P: 1790582169333565 usec, L: 0
0928 07:56:19.890856 (+ 463us) write_op.cc:270] Start()
0928 07:56:19.890932 (+ 76us) write_op.cc:276] Timestamp: P: 1790582169363834 usec, L: 0
0928 07:56:19.891363 (+ 431us) write_op.cc:270] Start()
0928 07:56:19.891430 (+ 67us) write_op.cc:276] Timestamp: P: 1790582169417475 usec, L: 0
0928 07:56:19.891895 (+ 465us) write_op.cc:270] Start()
0928 07:56:19.891979 (+ 84us) write_op.cc:276] Timestamp: P: 1790582169442654 usec, L: 0
0928 07:56:19.892457 (+ 478us) write_op.cc:270] Start()
0928 07:56:19.892529 (+ 72us) write_op.cc:276] Timestamp: P: 1790582169526044 usec, L: 0
0928 07:56:19.913930 (+ 21401us) write_op.cc:270] Start()
0928 07:56:19.914051 (+ 121us) write_op.cc:276] Timestamp: P: 1790582169587299 usec, L: 0
0928 07:56:19.914694 (+ 643us) write_op.cc:270] Start()
0928 07:56:19.914779 (+ 85us) write_op.cc:276] Timestamp: P: 1790582169611191 usec, L: 0
0928 07:56:19.915274 (+ 495us) write_op.cc:270] Start()
0928 07:56:19.915432 (+ 158us) write_op.cc:276] Timestamp: P: 1790582169650758 usec, L: 0
0928 07:56:19.915916 (+ 484us) write_op.cc:270] Start()
0928 07:56:19.916002 (+ 86us) write_op.cc:276] Timestamp: P: 1790582169724877 usec, L: 0
0928 07:56:19.916442 (+ 440us) write_op.cc:270] Start()
0928 07:56:19.916518 (+ 76us) write_op.cc:276] Timestamp: P: 1790582169774032 usec, L: 0
0928 07:56:19.916969 (+ 451us) write_op.cc:270] Start()
0928 07:56:19.917042 (+ 73us) write_op.cc:276] Timestamp: P: 1790582169792946 usec, L: 0
0928 07:56:19.917506 (+ 464us) write_op.cc:270] Start()
0928 07:56:19.917580 (+ 74us) write_op.cc:276] Timestamp: P: 1790582169805764 usec, L: 0
0928 07:56:19.918039 (+ 459us) write_op.cc:270] Start()
0928 07:56:19.918127 (+ 88us) write_op.cc:276] Timestamp: P: 1790582169815799 usec, L: 0
0928 07:56:19.918614 (+ 487us) write_op.cc:270] Start()
0928 07:56:19.918692 (+ 78us) write_op.cc:276] Timestamp: P: 1790582169909919 usec, L: 0
0928 07:56:19.928125 (+ 9433us) write_op.cc:270] Start()
0928 07:56:19.928220 (+ 95us) write_op.cc:276] Timestamp: P: 1790582170091158 usec, L: 0
0928 07:56:19.928737 (+ 517us) write_op.cc:270] Start()
0928 07:56:19.928816 (+ 79us) write_op.cc:276] Timestamp: P: 1790582170127740 usec, L: 0
0928 07:56:19.929342 (+ 526us) write_op.cc:270] Start()
0928 07:56:19.929429 (+ 87us) write_op.cc:276] Timestamp: P: 1790582170170898 usec, L: 0
0928 07:56:19.930644 (+ 1215us) write_op.cc:270] Start()
0928 07:56:19.930720 (+ 76us) write_op.cc:276] Timestamp: P: 1790582170312103 usec, L: 0
0928 07:56:19.931213 (+ 493us) write_op.cc:270] Start()
0928 07:56:19.931286 (+ 73us) write_op.cc:276] Timestamp: P: 1790582170331745 usec, L: 0
0928 07:56:19.931748 (+ 462us) write_op.cc:270] Start()
0928 07:56:19.931821 (+ 73us) write_op.cc:276] Timestamp: P: 1790582170412387 usec, L: 0
0928 07:56:19.932288 (+ 467us) write_op.cc:270] Start()
0928 07:56:19.932373 (+ 85us) write_op.cc:276] Timestamp: P: 1790582170441438 usec, L: 0
0928 07:56:19.932771 (+ 398us) write_op.cc:270] Start()
0928 07:56:19.932845 (+ 74us) write_op.cc:276] Timestamp: P: 1790582170588839 usec, L: 0
0928 07:56:19.933244 (+ 399us) write_op.cc:270] Start()
0928 07:56:19.933305 (+ 61us) write_op.cc:276] Timestamp: P: 1790582170638264 usec, L: 0
0928 07:56:19.933695 (+ 390us) write_op.cc:270] Start()
0928 07:56:19.933756 (+ 61us) write_op.cc:276] Timestamp: P: 1790582170770373 usec, L: 0
0928 07:56:19.934164 (+ 408us) write_op.cc:270] Start()
0928 07:56:19.934232 (+ 68us) write_op.cc:276] Timestamp: P: 1790582170794310 usec, L: 0
0928 07:56:19.934609 (+ 377us) write_op.cc:270] Start()
0928 07:56:19.952403 (+ 17794us) write_op.cc:276] Timestamp: P: 1790582170956083 usec, L: 0
0928 07:56:19.952963 (+ 560us) write_op.cc:270] Start()
0928 07:56:19.953046 (+ 83us) write_op.cc:276] Timestamp: P: 1790582171002987 usec, L: 0
0928 07:56:19.953498 (+ 452us) write_op.cc:270] Start()
0928 07:56:19.953564 (+ 66us) write_op.cc:276] Timestamp: P: 1790582171144627 usec, L: 0
0928 07:56:19.953994 (+ 430us) write_op.cc:270] Start()
0928 07:56:19.954065 (+ 71us) write_op.cc:276] Timestamp: P: 1790582171274431 usec, L: 0
0928 07:56:19.956386 (+ 2321us) write_op.cc:270] Start()
0928 07:56:19.956464 (+ 78us) write_op.cc:276] Timestamp: P: 1790582171276554 usec, L: 0
0928 07:56:19.960387 (+ 3923us) write_op.cc:270] Start()
0928 07:56:19.960461 (+ 74us) write_op.cc:276] Timestamp: P: 1790582171342705 usec, L: 0
0928 07:56:19.960909 (+ 448us) write_op.cc:270] Start()
0928 07:56:19.960976 (+ 67us) write_op.cc:276] Timestamp: P: 1790582171364251 usec, L: 0
0928 07:56:19.961431 (+ 455us) write_op.cc:270] Start()
0928 07:56:19.961513 (+ 82us) write_op.cc:276] Timestamp: P: 1790582171415512 usec, L: 0
0928 07:56:19.961923 (+ 410us) write_op.cc:270] Start()
0928 07:56:19.961994 (+ 71us) write_op.cc:276] Timestamp: P: 1790582171490324 usec, L: 0
0928 07:56:19.962391 (+ 397us) write_op.cc:270] Start()
0928 07:56:19.962456 (+ 65us) write_op.cc:276] Timestamp: P: 1790582171658119 usec, L: 0
0928 07:56:19.962934 (+ 478us) write_op.cc:270] Start()
0928 07:56:19.963032 (+ 98us) write_op.cc:276] Timestamp: P: 1790582171691621 usec, L: 0
0928 07:56:19.970549 (+ 7517us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b5400030300. stack: 00007f98fce24323 00007f98fce24220 00007f98fc9c8574 0000000000516964 00000000005168f9 00007f99043781a1 00007f990444cd99 00007f99044429bd 00007f99044063f7 00007f9904405ecf 00007f9903faf440 00007f9903fb8ba6 00007f9903fb7ffe 00007f9905018659 00007f9903694d34 00007f9903694cc2
0928 07:56:19.971070 (+ 521us) write_op.cc:270] Start()
0928 07:56:19.971159 (+ 89us) write_op.cc:276] Timestamp: P: 1790582171788224 usec, L: 0
0928 07:56:19.973627 (+ 2468us) write_op.cc:270] Start()
0928 07:56:19.973711 (+ 84us) write_op.cc:276] Timestamp: P: 1790582171961306 usec, L: 0
0928 07:56:19.974160 (+ 449us) write_op.cc:270] Start()
0928 07:56:19.974224 (+ 64us) write_op.cc:276] Timestamp: P: 1790582172008365 usec, L: 0
0928 07:56:19.974596 (+ 372us) write_op.cc:270] Start()
0928 07:56:19.974663 (+ 67us) write_op.cc:276] Timestamp: P: 1790582172018796 usec, L: 0
0928 07:56:19.975164 (+ 501us) write_op.cc:270] Start()
0928 07:56:19.975234 (+ 70us) write_op.cc:276] Timestamp: P: 1790582172089098 usec, L: 0
0928 07:56:19.975601 (+ 367us) write_op.cc:270] Start()
0928 07:56:19.975659 (+ 58us) write_op.cc:276] Timestamp: P: 1790582172111391 usec, L: 0
0928 07:56:19.976043 (+ 384us) write_op.cc:270] Start()
0928 07:56:19.976105 (+ 62us) write_op.cc:276] Timestamp: P: 1790582172139403 usec, L: 0
0928 07:56:19.976489 (+ 384us) write_op.cc:270] Start()
0928 07:56:19.976551 (+ 62us) write_op.cc:276] Timestamp: P: 1790582172255719 usec, L: 0
0928 07:56:19.976932 (+ 381us) write_op.cc:270] Start()
0928 07:56:19.976993 (+ 61us) write_op.cc:276] Timestamp: P: 1790582172322639 usec, L: 0
0928 07:56:19.977429 (+ 436us) write_op.cc:270] Start()
0928 07:56:19.977491 (+ 62us) write_op.cc:276] Timestamp: P: 1790582172447959 usec, L: 0
0928 07:56:19.977911 (+ 420us) write_op.cc:270] Start()
0928 07:56:19.977979 (+ 68us) write_op.cc:276] Timestamp: P: 1790582172494505 usec, L: 0
0928 07:56:19.978389 (+ 410us) write_op.cc:270] Start()
0928 07:56:19.978471 (+ 82us) write_op.cc:276] Timestamp: P: 1790582172513537 usec, L: 0
0928 07:56:19.978884 (+ 413us) write_op.cc:270] Start()
0928 07:56:19.978957 (+ 73us) write_op.cc:276] Timestamp: P: 1790582172604173 usec, L: 0
0928 07:56:19.979374 (+ 417us) write_op.cc:270] Start()
0928 07:56:19.979437 (+ 63us) write_op.cc:276] Timestamp: P: 1790582172835350 usec, L: 0
0928 07:56:19.979847 (+ 410us) write_op.cc:270] Start()
0928 07:56:19.979910 (+ 63us) write_op.cc:276] Timestamp: P: 1790582172872682 usec, L: 0
0928 07:56:19.980287 (+ 377us) write_op.cc:270] Start()
0928 07:56:19.980351 (+ 64us) write_op.cc:276] Timestamp: P: 1790582172875173 usec, L: 0
0928 07:56:19.980758 (+ 407us) write_op.cc:270] Start()
0928 07:56:19.980821 (+ 63us) write_op.cc:276] Timestamp: P: 1790582173315184 usec, L: 0
0928 07:56:19.981260 (+ 439us) write_op.cc:270] Start()
0928 07:56:19.981329 (+ 69us) write_op.cc:276] Timestamp: P: 1790582173339361 usec, L: 0
0928 07:56:19.981728 (+ 399us) write_op.cc:270] Start()
0928 07:56:19.981793 (+ 65us) write_op.cc:276] Timestamp: P: 1790582173460328 usec, L: 0
0928 07:56:20.034034 (+ 52241us) write_op.cc:270] Start()
0928 07:56:20.034153 (+ 119us) write_op.cc:276] Timestamp: P: 1790582173496865 usec, L: 0
0928 07:56:20.034718 (+ 565us) write_op.cc:270] Start()
0928 07:56:20.034804 (+ 86us) write_op.cc:276] Timestamp: P: 1790582173624818 usec, L: 0
0928 07:56:20.035312 (+ 508us) write_op.cc:270] Start()
0928 07:56:20.035399 (+ 87us) write_op.cc:276] Timestamp: P: 1790582173703619 usec, L: 0
0928 07:56:20.035913 (+ 514us) write_op.cc:270] Start()
0928 07:56:20.035982 (+ 69us) write_op.cc:276] Timestamp: P: 1790582173742440 usec, L: 0
0928 07:56:20.036339 (+ 357us) write_op.cc:270] Start()
0928 07:56:20.036403 (+ 64us) write_op.cc:276] Timestamp: P: 1790582173821691 usec, L: 0
0928 07:56:20.036769 (+ 366us) write_op.cc:270] Start()
0928 07:56:20.036841 (+ 72us) write_op.cc:276] Timestamp: P: 1790582173869656 usec, L: 0
0928 07:56:20.037237 (+ 396us) write_op.cc:270] Start()
0928 07:56:20.037300 (+ 63us) write_op.cc:276] Timestamp: P: 1790582174222802 usec, L: 0
0928 07:56:20.037665 (+ 365us) write_op.cc:270] Start()
0928 07:56:20.037728 (+ 63us) write_op.cc:276] Timestamp: P: 1790582174314299 usec, L: 0
0928 07:56:20.038112 (+ 384us) write_op.cc:270] Start()
0928 07:56:20.038172 (+ 60us) write_op.cc:276] Timestamp: P: 1790582174401680 usec, L: 0
0928 07:56:20.056671 (+ 18499us) write_op.cc:270] Start()
0928 07:56:20.056767 (+ 96us) write_op.cc:276] Timestamp: P: 1790582174494378 usec, L: 0
0928 07:56:20.057462 (+ 695us) write_op.cc:270] Start()
0928 07:56:20.057537 (+ 75us) write_op.cc:276] Timestamp: P: 1790582174524983 usec, L: 0
0928 07:56:20.057981 (+ 444us) write_op.cc:270] Start()
0928 07:56:20.058059 (+ 78us) write_op.cc:276] Timestamp: P: 1790582174557643 usec, L: 0
0928 07:56:20.058447 (+ 388us) write_op.cc:270] Start()
0928 07:56:20.058513 (+ 66us) write_op.cc:276] Timestamp: P: 1790582174647129 usec, L: 0
0928 07:56:20.058943 (+ 430us) write_op.cc:270] Start()
0928 07:56:20.059010 (+ 67us) write_op.cc:276] Timestamp: P: 1790582174705782 usec, L: 0
0928 07:56:20.059506 (+ 496us) write_op.cc:270] Start()
0928 07:56:20.059571 (+ 65us) write_op.cc:276] Timestamp: P: 1790582174751625 usec, L: 0
0928 07:56:20.059982 (+ 411us) write_op.cc:270] Start()
0928 07:56:20.060045 (+ 63us) write_op.cc:276] Timestamp: P: 1790582174824713 usec, L: 0
0928 07:56:20.060425 (+ 380us) write_op.cc:270] St
I20260928 07:56:22.777390 29467 raft_consensus.cc:385] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:22.776923 29464 raft_consensus.cc:359] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.777813 29467 raft_consensus.cc:740] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:22.780910 29464 raft_consensus.cc:385] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:22.781587 29467 consensus_queue.cc:260] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.782593 29464 raft_consensus.cc:740] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:22.790120 29454 consensus_queue.cc:260] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.792552 29454 ts_tablet_manager.cc:1434] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.203s user 0.008s sys 0.000s
I20260928 07:56:22.795336 29454 tablet_bootstrap.cc:492] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:22.805078 29454 tablet_bootstrap.cc:654] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.786928 29436 rpcz_store.cc:276] 0928 07:56:21.650116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:21.650262 (+ 146us) service_pool.cc:224] Handling call
0928 07:56:22.299291 (+649029us) ts_tablet_manager.cc:1151] Deleting tablet 11be687831574f5c961f703b03ce2c68
0928 07:56:22.299426 (+ 135us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:22.564496 (+265070us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:22.719023 (+154527us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:22.724074 (+ 5051us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":648405}
I20260928 07:56:22.826303 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 11be687831574f5c961f703b03ce2c68 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]) successfully deleted
I20260928 07:56:22.834076 29467 ts_tablet_manager.cc:1434] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.096s user 0.001s sys 0.006s
I20260928 07:56:22.787462 29464 consensus_queue.cc:260] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.859597 29464 ts_tablet_manager.cc:1434] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.099s user 0.006s sys 0.000s
I20260928 07:56:22.878755 29454 tablet_bootstrap.cc:492] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:22.885249 29454 ts_tablet_manager.cc:1403] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.090s user 0.011s sys 0.001s
I20260928 07:56:22.887995 29454 raft_consensus.cc:359] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.888717 29454 raft_consensus.cc:385] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:22.888991 29454 raft_consensus.cc:740] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:22.906893 29464 tablet_bootstrap.cc:492] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:22.917538 29454 consensus_queue.cc:260] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:22.920599 29454 ts_tablet_manager.cc:1434] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
I20260928 07:56:22.921587 29454 tablet_bootstrap.cc:492] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:22.938151 29496 catalog_manager.cc:692] Loaded metadata for table default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18]
I20260928 07:56:22.940016 29496 catalog_manager.cc:692] Loaded metadata for table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]
I20260928 07:56:22.948207 29464 tablet_bootstrap.cc:654] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.959408 29454 tablet_bootstrap.cc:654] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:22.981400 29496 catalog_manager.cc:692] Loaded metadata for table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]
I20260928 07:56:22.984748 29496 catalog_manager.cc:692] Loaded metadata for table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]
I20260928 07:56:22.987211 29496 catalog_manager.cc:692] Loaded metadata for table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]
I20260928 07:56:22.996714 29448 raft_consensus.cc:493] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:22.997356 29464 tablet_bootstrap.cc:492] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:22.997188 29448 raft_consensus.cc:515] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:22.997771 29464 ts_tablet_manager.cc:1403] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.008s
I20260928 07:56:22.999253 29448 leader_election.cc:290] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:23.001747 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62bc065c9f2743c9ae79dc37bc6de0c2" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:23.002357 28204 raft_consensus.cc:2468] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:23.003449 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62bc065c9f2743c9ae79dc37bc6de0c2" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:23.004072 28350 raft_consensus.cc:2468] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 0.
I20260928 07:56:23.006592 28434 leader_election.cc:304] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:23.008637 29448 raft_consensus.cc:2804] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:23.009142 29448 raft_consensus.cc:493] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:23.009577 29448 raft_consensus.cc:3060] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.000886 29464 raft_consensus.cc:359] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:23.021160 29464 raft_consensus.cc:385] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:23.021548 29464 raft_consensus.cc:740] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:23.021777 29448 raft_consensus.cc:515] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.023761 29483 raft_consensus.cc:493] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:23.024292 29483 raft_consensus.cc:515] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:23.026491 29483 leader_election.cc:290] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:23.027207 29454 tablet_bootstrap.cc:492] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:23.028277 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 6 candidate_status { last_received { term: 4 index: 272 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:56:23.028846 29238 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfb6604d9ebb423090c878c2b1db0cab in term 5.
I20260928 07:56:23.029100 29454 ts_tablet_manager.cc:1403] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.108s user 0.006s sys 0.005s
I20260928 07:56:23.030028 27816 leader_election.cc:304] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab; no voters:
I20260928 07:56:23.030941 29483 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260928 07:56:23.031440 29483 raft_consensus.cc:493] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:23.031875 29454 raft_consensus.cc:359] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.032191 29483 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 5 FOLLOWER]: Advancing to term 6
I20260928 07:56:23.032526 29454 raft_consensus.cc:385] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:23.032778 29454 raft_consensus.cc:740] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:22.988804 29496 catalog_manager.cc:692] Loaded metadata for table default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]
I20260928 07:56:23.033574 27511 master-stress-test.cc:579] Killing test thread 1/10
I20260928 07:56:23.037333 29496 catalog_manager.cc:692] Loaded metadata for table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]
I20260928 07:56:23.039002 29496 catalog_manager.cc:692] Loaded metadata for table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]
I20260928 07:56:23.038950 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62bc065c9f2743c9ae79dc37bc6de0c2" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:23.039546 28204 raft_consensus.cc:3060] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.041482 29464 consensus_queue.cc:260] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:23.052299 29464 ts_tablet_manager.cc:1434] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.054s user 0.003s sys 0.003s
I20260928 07:56:23.057904 29454 consensus_queue.cc:260] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.065482 29464 tablet_bootstrap.cc:492] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:23.076207 29496 catalog_manager.cc:692] Loaded metadata for table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]
I20260928 07:56:23.076691 28205 raft_consensus.cc:1275] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 2 FOLLOWER]: Refusing update from remote peer bae11841a62f429a98a978de5b7bd60e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 07:56:23.077061 28205 pending_rounds.cc:85] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting all ops after (but not including) 0
I20260928 07:56:23.077337 28205 pending_rounds.cc:107] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 07:56:23.077606 28205 raft_consensus.cc:2889] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 07:56:23.080448 29376 consensus_queue.cc:1048] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 07:56:23.081576 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet dda49b3ac3104f47bbfc2c780282abca consensus state has no leader
I20260928 07:56:23.061103 29454 ts_tablet_manager.cc:1434] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.032s user 0.004s sys 0.000s
I20260928 07:56:23.083863 29483 raft_consensus.cc:515] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:23.092551 29496 catalog_manager.cc:692] Loaded metadata for table default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02]
I20260928 07:56:23.098390 29496 catalog_manager.cc:692] Loaded metadata for table default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9]
I20260928 07:56:23.105942 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 6 candidate_status { last_received { term: 4 index: 272 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16"
I20260928 07:56:23.106525 29238 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 5 FOLLOWER]: Advancing to term 6
I20260928 07:56:23.115442 29238 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfb6604d9ebb423090c878c2b1db0cab in term 6.
I20260928 07:56:23.113660 29464 tablet_bootstrap.cc:654] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:23.117313 27816 leader_election.cc:304] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab; no voters:
I20260928 07:56:23.123333 29504 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 6 FOLLOWER]: Leader election won for term 6
I20260928 07:56:23.126443 29496 catalog_manager.cc:692] Loaded metadata for table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]
I20260928 07:56:23.124366 29483 leader_election.cc:290] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 6 election: Requested vote from peers f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:23.139649 29496 catalog_manager.cc:692] Loaded metadata for table default.table_2519a070e9974faeb26f6bcd4756d344 [id=5ede51d78549417b8bfc039f2d7c87f6]
I20260928 07:56:23.142226 29496 catalog_manager.cc:692] Loaded metadata for table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]
I20260928 07:56:23.147039 29503 raft_consensus.cc:493] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:23.149434 29503 raft_consensus.cc:515] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:23.156108 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a0cf784aee4d0e9b7b269182ba7de3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:23.156723 28499 raft_consensus.cc:2468] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:23.158565 28141 leader_election.cc:304] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:23.159439 28204 raft_consensus.cc:2468] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:23.159854 29503 leader_election.cc:290] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:23.160787 28434 leader_election.cc:304] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:23.161567 29376 raft_consensus.cc:2804] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:23.164353 29503 raft_consensus.cc:2804] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:23.164883 29503 raft_consensus.cc:493] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:23.166687 29503 raft_consensus.cc:3060] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.168569 29464 tablet_bootstrap.cc:492] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:23.169014 29464 ts_tablet_manager.cc:1403] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.104s user 0.001s sys 0.009s
I20260928 07:56:23.171618 29464 raft_consensus.cc:359] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.172071 28350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62bc065c9f2743c9ae79dc37bc6de0c2" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:23.172600 28350 raft_consensus.cc:3060] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.181847 29238 raft_consensus.cc:1240] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Rejecting Update request from peer f95afb2252e047ff9f5427a1cd7c0df0 for earlier term 5. Current term is 6. Ops: []
I20260928 07:56:23.182505 29496 catalog_manager.cc:692] Loaded metadata for table default.table_da656d08cd28419b8599a14b3946a15a [id=7d3bf1f44d9443b78713cb43948ae519]
I20260928 07:56:23.183782 29492 consensus_queue.cc:1059] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 271, Last known committed idx: 237, Time since last communication: 0.000s
I20260928 07:56:23.184731 29492 raft_consensus.cc:3055] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 5 LEADER]: Stepping down as leader of term 5
I20260928 07:56:23.184937 29496 catalog_manager.cc:692] Loaded metadata for table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]
I20260928 07:56:23.185063 29492 raft_consensus.cc:740] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f95afb2252e047ff9f5427a1cd7c0df0, State: Running, Role: LEADER
I20260928 07:56:23.185992 29492 consensus_queue.cc:260] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 270, Committed index: 270, Last appended: 5.271, Last appended by leader: 271, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:23.187407 29492 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 5 FOLLOWER]: Advancing to term 6
I20260928 07:56:23.175985 29464 raft_consensus.cc:385] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:23.193826 28350 raft_consensus.cc:2468] T 62bc065c9f2743c9ae79dc37bc6de0c2 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae11841a62f429a98a978de5b7bd60e in term 1.
I20260928 07:56:23.195003 29376 raft_consensus.cc:697] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [term 1 LEADER]: Becoming Leader. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Running, Role: LEADER
I20260928 07:56:23.195909 29376 consensus_queue.cc:237] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.190783 29464 raft_consensus.cc:740] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:23.200333 29496 catalog_manager.cc:692] Loaded metadata for table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]
I20260928 07:56:23.200505 29448 leader_election.cc:290] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:23.209751 29464 consensus_queue.cc:260] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.225343 29503 raft_consensus.cc:515] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:23.224398 29504 raft_consensus.cc:697] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 6 LEADER]: Becoming Leader. State: Replica: dfb6604d9ebb423090c878c2b1db0cab, State: Running, Role: LEADER
I20260928 07:56:23.234956 28350 raft_consensus.cc:1275] T 9e5a4815e0004b5e827e30ccbe9073f1 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 2 FOLLOWER]: Refusing update from remote peer bae11841a62f429a98a978de5b7bd60e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 07:56:23.238034 29496 catalog_manager.cc:692] Loaded metadata for table default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765]
I20260928 07:56:23.240557 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a0cf784aee4d0e9b7b269182ba7de3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:23.241103 28499 raft_consensus.cc:3060] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.241621 29504 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 270, Committed index: 270, Last appended: 4.272, Last appended by leader: 272, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:23.249392 29417 raft_consensus.cc:493] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:23.249986 29417 raft_consensus.cc:515] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.252820 29417 leader_election.cc:290] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:23.253443 29448 consensus_queue.cc:1048] T 9e5a4815e0004b5e827e30ccbe9073f1 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:23.257014 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c670de5690141bea18b9a07d1e950d4" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:23.257972 28494 raft_consensus.cc:2468] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:23.259660 28285 leader_election.cc:304] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:23.261507 29417 raft_consensus.cc:2804] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:23.262039 29417 raft_consensus.cc:493] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:23.262435 29417 raft_consensus.cc:3060] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.265632 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c670de5690141bea18b9a07d1e950d4" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:23.266425 28204 raft_consensus.cc:2468] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:23.253832 28499 raft_consensus.cc:2468] T 34a0cf784aee4d0e9b7b269182ba7de3 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:23.268414 28141 leader_election.cc:304] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:23.285765 29464 ts_tablet_manager.cc:1434] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.116s user 0.009s sys 0.004s
I20260928 07:56:23.286978 29501 raft_consensus.cc:2804] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:23.287549 29501 raft_consensus.cc:697] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:23.288455 29501 consensus_queue.cc:237] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:23.291927 29483 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 6 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:23.292899 29483 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:56:23.296552 29496 catalog_manager.cc:692] Loaded metadata for table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]
W20260928 07:56:23.298892 28142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 254886us
I20260928 07:56:23.343511 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a0cf784aee4d0e9b7b269182ba7de3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:23.343873 28349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a0cf784aee4d0e9b7b269182ba7de3" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:23.344168 28347 raft_consensus.cc:3060] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.353659 28347 raft_consensus.cc:2468] T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:23.293057 29503 leader_election.cc:290] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:23.366966 29417 raft_consensus.cc:515] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.375031 28499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c670de5690141bea18b9a07d1e950d4" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:23.375584 28499 raft_consensus.cc:3060] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.377195 28204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c670de5690141bea18b9a07d1e950d4" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:23.377727 28204 raft_consensus.cc:3060] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:23.382364 28499 raft_consensus.cc:2468] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:23.383538 28285 leader_election.cc:304] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters:
I20260928 07:56:23.384441 29443 raft_consensus.cc:2804] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:23.384902 29443 raft_consensus.cc:697] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:23.385739 29443 consensus_queue.cc:237] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:23.402069 29496 catalog_manager.cc:692] Loaded metadata for table default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55]
W20260928 07:56:23.410921 28142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 59257.4us
I20260928 07:56:23.415777 28204 raft_consensus.cc:2468] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:23.424412 29417 leader_election.cc:290] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:23.427659 29496 catalog_manager.cc:692] Loaded metadata for table default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595]
I20260928 07:56:23.429518 29496 catalog_manager.cc:692] Loaded metadata for table default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc]
I20260928 07:56:23.431321 29496 catalog_manager.cc:692] Loaded metadata for table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]
W20260928 07:56:23.563782 27813 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.221.253:45305 timed out after 0.517s (SENT) [suppressed 6 similar messages]
I20260928 07:56:23.575644 29496 tablet_loader.cc:96] loaded metadata for tablet 2de0f3ba82a4442588cbb547f3cf9881 (table default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55])
I20260928 07:56:23.578850 29496 tablet_loader.cc:96] loaded metadata for tablet 34a0cf784aee4d0e9b7b269182ba7de3 (table default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595])
I20260928 07:56:23.581821 29496 tablet_loader.cc:96] loaded metadata for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072])
I20260928 07:56:23.602998 29496 tablet_loader.cc:96] loaded metadata for tablet 3e70055265684586972191331e0dd5cd (table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7])
I20260928 07:56:23.604852 29492 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:23.605446 29492 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:23.607597 29492 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:23.608070 29496 tablet_loader.cc:96] loaded metadata for tablet 41352cf9a4974e2b861d2234d9a5accd (table default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc])
I20260928 07:56:23.609510 29496 tablet_loader.cc:96] loaded metadata for tablet 42897682db564e56b8e6bf8b75f8641c (table default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9])
I20260928 07:56:23.611224 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 7 candidate_status { last_received { term: 5 index: 271 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:56:23.611339 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 7 candidate_status { last_received { term: 5 index: 271 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:23.612103 29238 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f95afb2252e047ff9f5427a1cd7c0df0 in term 6.
I20260928 07:56:23.613605 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, f95afb2252e047ff9f5427a1cd7c0df0; no voters:
I20260928 07:56:23.615578 29492 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260928 07:56:23.616225 29492 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:23.616882 29492 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 6 FOLLOWER]: Advancing to term 7
I20260928 07:56:23.641819 29496 tablet_loader.cc:96] loaded metadata for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9])
I20260928 07:56:23.652659 29238 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Refusing update from remote peer dfb6604d9ebb423090c878c2b1db0cab: Log matching property violated. Preceding OpId in replica: term: 4 index: 237. Preceding OpId from leader: term: 6 index: 273. (index mismatch)
I20260928 07:56:23.654476 29483 consensus_queue.cc:1048] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 273, Last known committed idx: 237, Time since last communication: 0.001s
I20260928 07:56:23.651314 29496 tablet_loader.cc:96] loaded metadata for tablet 5c670de5690141bea18b9a07d1e950d4 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2])
I20260928 07:56:23.668220 29496 tablet_loader.cc:96] loaded metadata for tablet 62bc065c9f2743c9ae79dc37bc6de0c2 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6])
I20260928 07:56:23.687412 29496 tablet_loader.cc:96] loaded metadata for tablet 711949ab6f4548d09e06b849202d2d90 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3])
I20260928 07:56:23.688702 29496 tablet_loader.cc:96] loaded metadata for tablet 7ec9ebafa7c248ceb280587e49d964b7 (table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5])
I20260928 07:56:23.713706 29492 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:23.715823 29492 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 7 election: Requested vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:23.719684 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 7 candidate_status { last_received { term: 5 index: 271 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab"
I20260928 07:56:23.720544 29496 tablet_loader.cc:96] loaded metadata for tablet 8a991fd5fd32408ba8e1065a855b06d3 (table default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647])
I20260928 07:56:23.721122 29234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 7 candidate_status { last_received { term: 5 index: 271 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16"
I20260928 07:56:23.724730 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:23.726267 29496 tablet_loader.cc:96] loaded metadata for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9])
I20260928 07:56:23.729499 29492 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260928 07:56:23.732494 29417 consensus_queue.cc:1048] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:23.810747 29496 tablet_loader.cc:96] loaded metadata for tablet 8fe80328a63344f78528b8537b3dbf0c (table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4])
I20260928 07:56:23.820827 29496 tablet_loader.cc:96] loaded metadata for tablet 9e5a4815e0004b5e827e30ccbe9073f1 (table default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18])
I20260928 07:56:23.822244 29496 tablet_loader.cc:96] loaded metadata for tablet 9eaff4ec62804f00a750d1d31f44366d (table default.table_da656d08cd28419b8599a14b3946a15a [id=7d3bf1f44d9443b78713cb43948ae519])
I20260928 07:56:23.823354 29496 tablet_loader.cc:96] loaded metadata for tablet a018e7ed93784490a5510bafd25348df (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4])
I20260928 07:56:23.829730 29443 consensus_queue.cc:1048] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:23.841696 29496 tablet_loader.cc:96] loaded metadata for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed])
I20260928 07:56:23.861619 29496 tablet_loader.cc:96] loaded metadata for tablet b801232a1a4f4b0a80974fc838a3b6f5 (table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033])
I20260928 07:56:23.865199 29496 tablet_loader.cc:96] loaded metadata for tablet bbeec0005d4144a2a3b888b7dbcb5087 (table default.table_2519a070e9974faeb26f6bcd4756d344 [id=5ede51d78549417b8bfc039f2d7c87f6])
I20260928 07:56:23.868901 29496 tablet_loader.cc:96] loaded metadata for tablet c213348428a04c479f871d390b7e3c95 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264])
I20260928 07:56:23.909070 29496 tablet_loader.cc:96] loaded metadata for tablet d139c0b8379446dfba037e96e0501a0b (table default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02])
I20260928 07:56:23.927842 29496 tablet_loader.cc:96] loaded metadata for tablet d9cf8015fec54fb7874e93717fc8d38b (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625])
I20260928 07:56:23.949311 29496 tablet_loader.cc:96] loaded metadata for tablet fa4546b980894e68bb371bdda05058b6 (table default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765])
W20260928 07:56:23.953267 29496 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: Loading table and tablet metadata into memory: real 1.222s user 0.151s sys 0.034s
I20260928 07:56:23.953733 29496 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 07:56:23.954360 27911 raft_consensus.cc:1240] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Rejecting Update request from peer dfb6604d9ebb423090c878c2b1db0cab for earlier term 6. Current term is 7. Ops: []
I20260928 07:56:23.956861 29483 consensus_queue.cc:1059] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 }, Status: INVALID_TERM, Last received: 0.0, Next index: 273, Last known committed idx: 270, Time since last communication: 0.001s
I20260928 07:56:23.953302 27913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 6 candidate_status { last_received { term: 4 index: 272 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
I20260928 07:56:23.958560 27913 raft_consensus.cc:2368] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dfb6604d9ebb423090c878c2b1db0cab for earlier term 6. Current term is 7.
W20260928 07:56:23.959005 27913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48076 (request call id 520) took 859 ms (client timeout 690 ms). Trace:
W20260928 07:56:23.959602 27913 rpcz_store.cc:269] 0928 07:56:23.099279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:23.099405 (+ 126us) service_pool.cc:224] Handling call
0928 07:56:23.958899 (+859494us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:23.953364 27912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 6 candidate_status { last_received { term: 4 index: 272 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:56:23.961741 27912 raft_consensus.cc:2368] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfb6604d9ebb423090c878c2b1db0cab for earlier term 6. Current term is 7.
W20260928 07:56:23.962103 27912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48076 (request call id 519) took 934 ms (client timeout 517 ms). Trace:
W20260928 07:56:23.962409 27912 rpcz_store.cc:269] 0928 07:56:23.028181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:23.028328 (+ 147us) service_pool.cc:224] Handling call
0928 07:56:23.962038 (+933710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:23.963996 27910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 6 candidate_status { last_received { term: 4 index: 272 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
I20260928 07:56:23.964732 27910 raft_consensus.cc:2368] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dfb6604d9ebb423090c878c2b1db0cab for earlier term 6. Current term is 7.
I20260928 07:56:23.966224 27813 leader_election.cc:400] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 6 election: Vote denied by peer f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dfb6604d9ebb423090c878c2b1db0cab for earlier term 6. Current term is 7.
I20260928 07:56:23.966328 29523 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 6 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:23.967092 29523 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:56:23.967340 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 6 candidate_status { last_received { term: 4 index: 272 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:56:23.968353 27914 raft_consensus.cc:2368] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfb6604d9ebb423090c878c2b1db0cab for earlier term 6. Current term is 7.
I20260928 07:56:23.970245 27813 leader_election.cc:400] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 6 pre-election: Vote denied by peer f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfb6604d9ebb423090c878c2b1db0cab for earlier term 6. Current term is 7.
I20260928 07:56:23.984297 29496 catalog_manager.cc:1308] Loaded cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:56:23.984681 29496 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 07:56:23.993932 29483 consensus_queue.cc:1243] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Peer f95afb2252e047ff9f5427a1cd7c0df0 log is divergent from this leader: its last log entry 5.271 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 270
I20260928 07:56:23.999446 29496 catalog_manager.cc:1553] Loading token signing keys...
I20260928 07:56:24.005695 29532 raft_consensus.cc:3055] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 6 LEADER]: Stepping down as leader of term 6
I20260928 07:56:24.006114 29532 raft_consensus.cc:740] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dfb6604d9ebb423090c878c2b1db0cab, State: Running, Role: LEADER
I20260928 07:56:24.008126 29532 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 273, Committed index: 273, Last appended: 6.273, Last appended by leader: 273, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:24.026472 29496 catalog_manager.cc:6230] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: Loaded TSK: 0
I20260928 07:56:24.034842 29532 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 6 FOLLOWER]: Advancing to term 7
I20260928 07:56:24.036396 29496 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 07:56:24.057173 29496 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 07:56:24.101400 29496 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 45
I20260928 07:56:24.145889 29503 consensus_queue.cc:1048] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:24.205669 29503 consensus_queue.cc:1048] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:24.207192 29523 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:24.207680 29523 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:24.209794 29523 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:56:24.212477 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 273 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:56:24.212507 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 273 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:24.213148 27914 raft_consensus.cc:2393] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b64b51f6f084474eb360161ac99f9b16 in current term 7: Already voted for candidate f95afb2252e047ff9f5427a1cd7c0df0 in this term.
I20260928 07:56:24.213111 27839 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b64b51f6f084474eb360161ac99f9b16 in term 7.
I20260928 07:56:24.215415 29137 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab; no voters: f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:56:24.242233 29523 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260928 07:56:24.242779 29523 raft_consensus.cc:493] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:24.243443 29523 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 6 FOLLOWER]: Advancing to term 7
I20260928 07:56:24.257022 29508 consensus_queue.cc:1048] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:24.293792 29537 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:24.294251 29537 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:24.297046 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 8 candidate_status { last_received { term: 5 index: 271 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:24.297922 27839 raft_consensus.cc:2410] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f95afb2252e047ff9f5427a1cd7c0df0 for term 8 because replica has last-logged OpId of term: 6 index: 273, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 271.
I20260928 07:56:24.300387 29537 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:24.302069 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 8 candidate_status { last_received { term: 5 index: 271 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:56:24.307314 29508 consensus_queue.cc:1048] T 62bc065c9f2743c9ae79dc37bc6de0c2 P bae11841a62f429a98a978de5b7bd60e [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 07:56:24.335733 29534 log.cc:927] Time spent T 34a0cf784aee4d0e9b7b269182ba7de3 P 3bd67de620c94af3b7c8e3ba7d42f980: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260928 07:56:24.277953 29523 raft_consensus.cc:515] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:24.364398 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 273 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab"
I20260928 07:56:24.364579 29523 leader_election.cc:290] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 7 election: Requested vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305)
I20260928 07:56:24.367031 29238 raft_consensus.cc:2410] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f95afb2252e047ff9f5427a1cd7c0df0 for term 8 because replica has last-logged OpId of term: 6 index: 273, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 271.
I20260928 07:56:24.369987 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b64b51f6f084474eb360161ac99f9b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 273 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
I20260928 07:56:24.370707 27914 raft_consensus.cc:2393] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b64b51f6f084474eb360161ac99f9b16 in current term 7: Already voted for candidate f95afb2252e047ff9f5427a1cd7c0df0 in this term.
I20260928 07:56:24.370774 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:24.371662 29537 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260928 07:56:24.372041 29517 op_tracker.cc:284] OpTracker waiting for 2 outstanding ops to complete now for 1.048s
I20260928 07:56:24.372412 29517 op_tracker.cc:286] Dumping up to 50 currently running ops:
I20260928 07:56:24.372637 29517 op_tracker.cc:290] R-P WriteOp [type=LEADER, start_time=2026-09-28 07:56:22, state=WriteOpState 0x7b5800153900 [op_id=(), ts=7334224619272335360, rows=[MUTATE (int8 entry_type=<redacted>, string entry_id=<redacted>) SET metadata=<redacted>, MUTATE (int8 entry_type=<redacted>, string entry_id=<redacted>) SET metadata=<redacted>]]]
I20260928 07:56:24.373742 29517 op_tracker.cc:290] R-P WriteOp [type=LEADER, start_time=2026-09-28 07:56:22, state=WriteOpState 0x7b5800092100 [op_id=(), ts=7334224619122966528, rows=[INSERT (int8 entry_type=<redacted>, string entry_id=<redacted>, string metadata=<redacted>), MUTATE (int8 entry_type=<redacted>, string entry_id=<redacted>) SET metadata=<redacted>]]]
I20260928 07:56:24.375882 27839 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b64b51f6f084474eb360161ac99f9b16 in term 7.
I20260928 07:56:24.377202 29137 leader_election.cc:304] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab; no voters: f95afb2252e047ff9f5427a1cd7c0df0
I20260928 07:56:24.443951 29523 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260928 07:56:24.471383 29523 raft_consensus.cc:697] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [term 7 LEADER]: Becoming Leader. State: Replica: b64b51f6f084474eb360161ac99f9b16, State: Running, Role: LEADER
I20260928 07:56:24.472483 29523 consensus_queue.cc:237] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 270, Committed index: 270, Last appended: 6.273, Last appended by leader: 273, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:24.477065 29544 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b64b51f6f084474eb360161ac99f9b16. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:24.482267 29544 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: LEADER
I20260928 07:56:24.491212 29455 consensus_queue.cc:1048] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:24.524832 29443 consensus_queue.cc:1048] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 07:56:24.649725 28286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.193:33039, user_credentials={real_user=slave}} blocked reactor thread for 65940.2us
I20260928 07:56:24.972241 27839 raft_consensus.cc:1275] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Refusing update from remote peer b64b51f6f084474eb360161ac99f9b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 273. Preceding OpId from leader: term: 7 index: 274. (index mismatch)
I20260928 07:56:24.975075 29544 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 274, Last known committed idx: 273, Time since last communication: 0.000s
I20260928 07:56:25.000425 29553 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: New leader b64b51f6f084474eb360161ac99f9b16. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:25.002157 29553 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:56:25.036841 27826 catalog_manager.cc:6133] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Sending DeleteTablet for 3 replicas of tablet c213348428a04c479f871d390b7e3c95
I20260928 07:56:25.038537 27826 catalog_manager.cc:6934] ReplaceTablet: tablet c213348428a04c479f871d390b7e3c95 deleted and replaced by tablet d4fa2c780a744b30be854f00223cb472
I20260928 07:56:25.038985 27826 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51542 (request call id 152) took 3357 ms. Trace:
I20260928 07:56:25.041839 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet c213348428a04c479f871d390b7e3c95 with delete_type TABLET_DATA_DELETED (replaced by tablet d4fa2c780a744b30be854f00223cb472) from {username='slave'} at 127.0.0.1:54230
I20260928 07:56:25.042541 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet c213348428a04c479f871d390b7e3c95 with delete_type TABLET_DATA_DELETED (replaced by tablet d4fa2c780a744b30be854f00223cb472) from {username='slave'} at 127.0.0.1:60428
I20260928 07:56:25.044755 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet c213348428a04c479f871d390b7e3c95 with delete_type TABLET_DATA_DELETED (replaced by tablet d4fa2c780a744b30be854f00223cb472) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:25.039309 27826 rpcz_store.cc:276] 0928 07:56:21.681778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:22.350998 (+669220us) service_pool.cc:224] Handling call
0928 07:56:22.395576 (+ 44578us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54000203d4. stack: 00007f6ecc595323 00007f6ecc595220 00007f6ecc139574 0000000000516964 00000000005168f9 00007f6ed36935c0 00007f6ed37326fa 00007f6ed54a3d8c 00007f6ed55a60e1 00007f6ed316ed37 00007f6ed316ecc2 00007f6ed316ebf1 00007f6ed316eb6c 00007f6ed316de22 00007f6ed13f809c 00007f6ed13f74d6
0928 07:56:25.038906 (+2643330us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:22.400523 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:22.401018 (+ 495us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:22.401046 (+ 28us) write_op.cc:435] Acquired schema lock
0928 07:56:22.401062 (+ 16us) tablet.cc:662] Decoding operations
0928 07:56:22.402685 (+ 1623us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:22.402737 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:22.402777 (+ 40us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:22.403009 (+ 232us) tablet.cc:701] Row locks acquired
0928 07:56:22.403025 (+ 16us) write_op.cc:260] PREPARE: finished
0928 07:56:22.403152 (+ 127us) write_op.cc:270] Start()
0928 07:56:22.403245 (+ 93us) write_op.cc:276] Timestamp: P: 1790582182403068 usec, L: 0
0928 07:56:22.403265 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 07:56:22.403891 (+ 626us) log.cc:844] Serialized 665 byte log entry
0928 07:56:25.014541 (+2610650us) op_driver.cc:464] REPLICATION: finished
0928 07:56:25.031646 (+ 17105us) write_op.cc:301] APPLY: starting
0928 07:56:25.031722 (+ 76us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:25.031861 (+ 139us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:25.031980 (+ 119us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:25.032445 (+ 465us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:25.032682 (+ 237us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 07:56:25.032733 (+ 51us) write_op.cc:312] APPLY: finished
0928 07:56:25.033039 (+ 306us) log.cc:844] Serialized 29 byte log entry
0928 07:56:25.033202 (+ 163us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:25.033303 (+ 101us) write_op.cc:454] Released schema lock
0928 07:56:25.033345 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":94339456,"child_traces":[["op",{"apply.queue_time_us":16862,"num_ops":2,"prepare.queue_time_us":2205,"prepare.run_cpu_time_us":2374,"prepare.run_wall_time_us":3602,"replication_time_us":2611150,"thread_start_us":18747,"threads_started":1}]]}
W20260928 07:56:25.066720 27826 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.193:56531 (request call id 152) took 2666 ms (client timeout 1000 ms). Trace:
W20260928 07:56:25.067225 27826 rpcz_store.cc:269] 0928 07:56:22.400792 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.066338 (+2665546us) service_pool.cc:211] Skipping call since client already timed out
0928 07:56:25.066626 (+ 288us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 07:56:25.068164 29564 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 07:56:25.068867 27826 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.194:49827 (request call id 143) took 2072 ms (client timeout 1000 ms). Trace:
W20260928 07:56:25.069670 27826 rpcz_store.cc:269] 0928 07:56:22.996332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.068659 (+2072327us) service_pool.cc:211] Skipping call since client already timed out
0928 07:56:25.068802 (+ 143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 07:56:25.069005 29564 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:25.073302 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 8 candidate_status { last_received { term: 5 index: 271 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:25.074388 29562 tablet_replica.cc:333] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:25.074712 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 8 candidate_status { last_received { term: 5 index: 271 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:56:25.075698 29562 raft_consensus.cc:2243] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:25.076184 29564 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:25.076683 29560 tablet_replica.cc:333] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:25.077049 29562 raft_consensus.cc:2272] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:25.077692 29560 raft_consensus.cc:2243] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:25.078224 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:25.085387 29564 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260928 07:56:25.085731 29560 raft_consensus.cc:2272] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:25.086385 29562 ts_tablet_manager.cc:1916] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:25.088325 29560 ts_tablet_manager.cc:1916] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:25.087942 29544 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:25.088651 29544 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: LEADER
I20260928 07:56:25.089758 27914 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Refusing update from remote peer b64b51f6f084474eb360161ac99f9b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 271. Preceding OpId from leader: term: 7 index: 274. (index mismatch)
I20260928 07:56:25.091333 29544 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 274, Last known committed idx: 270, Time since last communication: 0.000s
I20260928 07:56:25.091904 29544 consensus_queue.cc:1243] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [LEADER]: Peer f95afb2252e047ff9f5427a1cd7c0df0 log is divergent from this leader: its last log entry 5.271 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 270
I20260928 07:56:25.092629 29545 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 07:56:25.095007 27914 pending_rounds.cc:85] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: Aborting all ops after (but not including) 270
I20260928 07:56:25.095310 27914 pending_rounds.cc:107] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0: Aborting uncommitted NO_OP operation due to leader change: 5.271
I20260928 07:56:25.095613 27914 raft_consensus.cc:2889] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 07:56:25.105664 29544 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:25.106515 29544 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: LEADER
W20260928 07:56:25.111774 27826 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.195:41067 (request call id 147) took 1992 ms (client timeout 1000 ms). Trace:
W20260928 07:56:25.112246 27826 rpcz_store.cc:269] 0928 07:56:23.118939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.111554 (+1992615us) service_pool.cc:211] Skipping call since client already timed out
0928 07:56:25.111703 (+ 149us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 07:56:25.113848 27826 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.193:56531 (request call id 153) took 1656 ms (client timeout 1000 ms). Trace:
W20260928 07:56:25.114341 27826 rpcz_store.cc:269] 0928 07:56:23.457190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.113664 (+1656474us) service_pool.cc:211] Skipping call since client already timed out
0928 07:56:25.113783 (+ 119us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 07:56:25.114333 29545 catalog_manager.cc:692] Loaded metadata for table default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18]
W20260928 07:56:25.115790 27826 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.194:49827 (request call id 144) took 1075 ms (client timeout 1000 ms). Trace:
I20260928 07:56:25.116343 29545 catalog_manager.cc:692] Loaded metadata for table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]
I20260928 07:56:25.118048 29545 catalog_manager.cc:692] Loaded metadata for table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]
I20260928 07:56:25.119642 29545 catalog_manager.cc:692] Loaded metadata for table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]
I20260928 07:56:25.121791 29545 catalog_manager.cc:692] Loaded metadata for table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]
I20260928 07:56:25.123240 29545 catalog_manager.cc:692] Loaded metadata for table default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647]
I20260928 07:56:25.124274 29561 tablet_replica.cc:333] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:25.124650 29545 catalog_manager.cc:692] Loaded metadata for table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]
I20260928 07:56:25.125315 29561 raft_consensus.cc:2243] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:25.126044 29561 raft_consensus.cc:2272] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:25.126196 29545 catalog_manager.cc:692] Loaded metadata for table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]
I20260928 07:56:25.127844 29545 catalog_manager.cc:692] Loaded metadata for table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]
I20260928 07:56:25.129490 29545 catalog_manager.cc:692] Loaded metadata for table default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02]
I20260928 07:56:25.131175 29545 catalog_manager.cc:692] Loaded metadata for table default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9]
I20260928 07:56:25.132786 29545 catalog_manager.cc:692] Loaded metadata for table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]
I20260928 07:56:25.135850 29545 catalog_manager.cc:692] Loaded metadata for table default.table_2519a070e9974faeb26f6bcd4756d344 [id=5ede51d78549417b8bfc039f2d7c87f6]
I20260928 07:56:25.138196 29545 catalog_manager.cc:692] Loaded metadata for table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]
W20260928 07:56:25.138309 27826 rpcz_store.cc:269] 0928 07:56:24.040170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.115644 (+1075474us) service_pool.cc:211] Skipping call since client already timed out
0928 07:56:25.115739 (+ 95us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 07:56:25.139850 29545 catalog_manager.cc:692] Loaded metadata for table default.table_da656d08cd28419b8599a14b3946a15a [id=7d3bf1f44d9443b78713cb43948ae519]
I20260928 07:56:25.141458 29545 catalog_manager.cc:692] Loaded metadata for table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]
I20260928 07:56:25.143289 29545 catalog_manager.cc:692] Loaded metadata for table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]
I20260928 07:56:25.146095 29545 catalog_manager.cc:692] Loaded metadata for table default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765]
I20260928 07:56:25.145151 29560 ts_tablet_manager.cc:1929] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:25.148346 29545 catalog_manager.cc:692] Loaded metadata for table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]
I20260928 07:56:25.148425 29560 log.cc:1199] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/c213348428a04c479f871d390b7e3c95
I20260928 07:56:25.149340 29560 ts_tablet_manager.cc:1950] T c213348428a04c479f871d390b7e3c95 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:25.151690 29545 catalog_manager.cc:692] Loaded metadata for table default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55]
E20260928 07:56:25.152629 28094 catalog_manager.cc:839] Error processing pending assignments: Illegal state: error persisting updated tablet metadata: replica dfb6604d9ebb423090c878c2b1db0cab is not leader of this config: current role FOLLOWER
I20260928 07:56:25.153270 29545 catalog_manager.cc:692] Loaded metadata for table default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595]
I20260928 07:56:25.154992 29545 catalog_manager.cc:692] Loaded metadata for table default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc]
I20260928 07:56:25.156692 29545 catalog_manager.cc:692] Loaded metadata for table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]
I20260928 07:56:25.159518 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 11be687831574f5c961f703b03ce2c68 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c670de5690141bea18b9a07d1e950d4) from {username='slave'} at 127.0.0.1:50372
I20260928 07:56:25.120841 29562 ts_tablet_manager.cc:1929] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:25.160527 29562 log.cc:1199] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/c213348428a04c479f871d390b7e3c95
W20260928 07:56:25.157966 27823 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.195:41067 (request call id 146) took 3056 ms (client timeout 1000 ms). Trace:
W20260928 07:56:25.158747 27824 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.194:49827 (request call id 142) took 3170 ms (client timeout 1000 ms). Trace:
I20260928 07:56:25.158951 27815 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet c213348428a04c479f871d390b7e3c95 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
W20260928 07:56:25.144006 27826 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.195:41067 (request call id 148) took 1016 ms (client timeout 1000 ms). Trace:
W20260928 07:56:25.163837 27826 rpcz_store.cc:269] 0928 07:56:24.127288 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.143813 (+1016525us) service_pool.cc:211] Skipping call since client already timed out
0928 07:56:25.143942 (+ 129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 07:56:25.161718 27824 rpcz_store.cc:269] 0928 07:56:21.988384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:22.080852 (+ 92468us) service_pool.cc:224] Handling call
0928 07:56:25.158569 (+3077717us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:22.437775 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:22.438412 (+ 637us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:22.438449 (+ 37us) write_op.cc:435] Acquired schema lock
0928 07:56:22.438472 (+ 23us) tablet.cc:662] Decoding operations
0928 07:56:22.438936 (+ 464us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:22.438991 (+ 55us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:22.439028 (+ 37us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:22.439453 (+ 425us) tablet.cc:701] Row locks acquired
0928 07:56:22.439473 (+ 20us) write_op.cc:260] PREPARE: finished
0928 07:56:22.439679 (+ 206us) write_op.cc:270] Start()
0928 07:56:22.439778 (+ 99us) write_op.cc:276] Timestamp: P: 1790582182439535 usec, L: 0
0928 07:56:22.439795 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 07:56:22.440371 (+ 576us) log.cc:844] Serialized 919 byte log entry
0928 07:56:25.033734 (+2593363us) op_driver.cc:464] REPLICATION: finished
0928 07:56:25.132025 (+ 98291us) write_op.cc:301] APPLY: starting
0928 07:56:25.132097 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:25.132220 (+ 123us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:25.132329 (+ 109us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:25.132666 (+ 337us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:25.132814 (+ 148us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 07:56:25.132856 (+ 42us) write_op.cc:312] APPLY: finished
0928 07:56:25.133042 (+ 186us) log.cc:844] Serialized 29 byte log entry
0928 07:56:25.133726 (+ 684us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:25.133815 (+ 89us) write_op.cc:454] Released schema lock
0928 07:56:25.133849 (+ 34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":98121,"apply.run_cpu_time_us":1530,"apply.run_wall_time_us":2047,"num_ops":2,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":2928,"prepare.run_wall_time_us":2928,"replication_time_us":2593828,"thread_start_us":105072,"threads_started":1}]]}
W20260928 07:56:25.169196 27823 rpcz_store.cc:269] 0928 07:56:22.101647 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:22.225405 (+123758us) service_pool.cc:224] Handling call
0928 07:56:22.325850 (+100445us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b54000203d4. stack: 00007f6ecc595323 00007f6ecc595220 00007f6ecc139574 0000000000516964 00000000005168f9 00007f6ed36935c0 00007f6ed37326fa 00007f6ed54a3d8c 00007f6ed55a201e 00007f6ed3146fb4 00007f6ed3146f42 00007f6ed3146e71 00007f6ed3146dec 00007f6ed31460a2 00007f6ed13f809c 00007f6ed13f74d6
0928 07:56:25.157761 (+2831911us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":122435456}
I20260928 07:56:25.170655 29562 ts_tablet_manager.cc:1950] T c213348428a04c479f871d390b7e3c95 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:25.172837 29561 ts_tablet_manager.cc:1916] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:25.178691 27814 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet c213348428a04c479f871d390b7e3c95 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
W20260928 07:56:25.180611 27814 catalog_manager.cc:5030] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): delete failed for tablet 11be687831574f5c961f703b03ce2c68 because the tablet was not found. No further retry: Not found: Tablet not found: 11be687831574f5c961f703b03ce2c68
I20260928 07:56:25.183189 29553 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:25.183907 29553 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: FOLLOWER
W20260928 07:56:25.186110 28092 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events
I20260928 07:56:25.188009 27829 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 142) took 6518 ms. Trace:
I20260928 07:56:25.188299 29545 tablet_loader.cc:96] loaded metadata for tablet 2de0f3ba82a4442588cbb547f3cf9881 (table default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55])
I20260928 07:56:25.188344 27829 rpcz_store.cc:276] 0928 07:56:18.669412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.676581 (+ 7169us) service_pool.cc:224] Handling call
0928 07:56:25.187815 (+6511234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:25.189668 27829 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ad8656a1c06494b9ebc9eb2e9512b41 from {username='slave'} at 127.0.0.1:51542
I20260928 07:56:25.190869 27829 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51542 (request call id 153) took 2983 ms. Trace:
I20260928 07:56:25.191177 27823 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 154) took 2630 ms. Trace:
I20260928 07:56:25.191532 27823 rpcz_store.cc:276] 0928 07:56:22.561000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.190207 (+2629207us) service_pool.cc:224] Handling call
0928 07:56:25.191121 (+ 914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:25.192023 29545 tablet_loader.cc:96] loaded metadata for tablet 34a0cf784aee4d0e9b7b269182ba7de3 (table default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595])
I20260928 07:56:25.194851 29545 tablet_loader.cc:96] loaded metadata for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072])
I20260928 07:56:25.196849 29545 tablet_loader.cc:96] loaded metadata for tablet 3e70055265684586972191331e0dd5cd (table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7])
I20260928 07:56:25.197783 27823 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:42706 (request call id 1) took 4671 ms. Trace:
I20260928 07:56:25.198094 27823 rpcz_store.cc:276] 0928 07:56:20.526636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.192173 (+4665537us) service_pool.cc:224] Handling call
0928 07:56:25.197694 (+ 5521us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 07:56:25.198378 27827 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e54258c46322425fad34e060fa60546a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:25.199007 29545 tablet_loader.cc:96] loaded metadata for tablet 41352cf9a4974e2b861d2234d9a5accd (table default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc])
I20260928 07:56:25.200271 29545 tablet_loader.cc:96] loaded metadata for tablet 42897682db564e56b8e6bf8b75f8641c (table default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9])
W20260928 07:56:25.202316 27828 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e67f035c8fbf43c4ab59b6f0c127d5a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:25.203303 29545 tablet_loader.cc:96] loaded metadata for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9])
I20260928 07:56:25.221167 27821 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 134) took 7769 ms. Trace:
I20260928 07:56:25.219817 29545 tablet_loader.cc:96] loaded metadata for tablet 5c670de5690141bea18b9a07d1e950d4 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2])
I20260928 07:56:25.221652 27821 rpcz_store.cc:276] 0928 07:56:17.427802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:17.437919 (+ 10117us) service_pool.cc:224] Handling call
0928 07:56:18.587829 (+1149910us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:25.194412 (+6606583us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:25.196257 (+ 1845us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:25.197147 (+ 890us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":5309,"Hive Metastore.run_cpu_time_us":2272,"Hive Metastore.run_wall_time_us":2018401}
I20260928 07:56:25.223616 29545 tablet_loader.cc:96] loaded metadata for tablet 62bc065c9f2743c9ae79dc37bc6de0c2 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6])
I20260928 07:56:25.229282 29545 tablet_loader.cc:96] loaded metadata for tablet 711949ab6f4548d09e06b849202d2d90 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3])
I20260928 07:56:25.191184 27829 rpcz_store.cc:276] 0928 07:56:22.207544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.189500 (+2981956us) service_pool.cc:224] Handling call
0928 07:56:25.190774 (+ 1274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:25.233855 29545 tablet_loader.cc:96] loaded metadata for tablet 7ec9ebafa7c248ceb280587e49d964b7 (table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5])
I20260928 07:56:25.252254 29545 tablet_loader.cc:96] loaded metadata for tablet 8a991fd5fd32408ba8e1065a855b06d3 (table default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647])
I20260928 07:56:25.253436 29545 tablet_loader.cc:96] loaded metadata for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9])
I20260928 07:56:25.258360 29545 tablet_loader.cc:96] loaded metadata for tablet 8fe80328a63344f78528b8537b3dbf0c (table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4])
I20260928 07:56:25.262346 29545 tablet_loader.cc:96] loaded metadata for tablet 9e5a4815e0004b5e827e30ccbe9073f1 (table default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18])
I20260928 07:56:25.268133 29545 tablet_loader.cc:96] loaded metadata for tablet 9eaff4ec62804f00a750d1d31f44366d (table default.table_da656d08cd28419b8599a14b3946a15a [id=7d3bf1f44d9443b78713cb43948ae519])
I20260928 07:56:25.269166 29545 tablet_loader.cc:96] loaded metadata for tablet a018e7ed93784490a5510bafd25348df (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4])
I20260928 07:56:25.280296 29545 tablet_loader.cc:96] loaded metadata for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed])
I20260928 07:56:25.298853 29545 tablet_loader.cc:96] loaded metadata for tablet b801232a1a4f4b0a80974fc838a3b6f5 (table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033])
I20260928 07:56:25.302577 29545 tablet_loader.cc:96] loaded metadata for tablet bbeec0005d4144a2a3b888b7dbcb5087 (table default.table_2519a070e9974faeb26f6bcd4756d344 [id=5ede51d78549417b8bfc039f2d7c87f6])
I20260928 07:56:25.310708 29545 tablet_loader.cc:96] loaded metadata for tablet d139c0b8379446dfba037e96e0501a0b (table default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02])
I20260928 07:56:25.313028 29545 tablet_loader.cc:96] loaded metadata for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264])
I20260928 07:56:25.316088 29545 tablet_loader.cc:96] loaded metadata for tablet d9cf8015fec54fb7874e93717fc8d38b (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625])
I20260928 07:56:25.322853 29545 tablet_loader.cc:96] loaded metadata for tablet fa4546b980894e68bb371bdda05058b6 (table default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765])
I20260928 07:56:25.325762 29545 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 07:56:25.336016 29517 catalog_manager.cc:1471] Term changed from 6 to 7 while waiting for master leader catchup. Not loading sys catalog metadata
I20260928 07:56:25.343245 29545 catalog_manager.cc:1308] Loaded cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:56:25.347927 29545 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 07:56:25.363279 29545 catalog_manager.cc:1553] Loading token signing keys...
I20260928 07:56:25.364609 29564 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b64b51f6f084474eb360161ac99f9b16. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:25.365388 29564 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:56:25.365933 29573 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:25.369042 29573 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 07:56:25.374258 27826 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.26.221.193:56531 (request call id 154) took 904 ms (client timeout 1000 ms). Trace:
I20260928 07:56:25.378518 29545 catalog_manager.cc:6230] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Loaded TSK: 0
I20260928 07:56:25.379827 29545 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 07:56:25.395049 29545 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 07:56:25.404645 29576 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:25.405802 29576 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:56:25.409916 29545 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 45
W20260928 07:56:25.410516 27826 rpcz_store.cc:269] 0928 07:56:24.469905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.164857 (+694952us) service_pool.cc:224] Handling call
0928 07:56:25.323366 (+158509us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5800001120. stack: 00007f6ecc595323 00007f6ecc595220 00007f6ecc139574 0000000000516964 00000000005168f9 00007f6ecc44b8a1 00007f6ecc58fb51 00007f6ecc590092 00007f6ed553b219 00007f6ed54d3c36 00007f6ed54a3c48 00007f6ed55a201e 00007f6ed3146fb4 00007f6ed3146f42 00007f6ed3146e71 00007f6ed3146dec
0928 07:56:25.374182 (+ 50816us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356699392}
I20260928 07:56:25.462325 29584 tablet.cc:1751] T 9eaff4ec62804f00a750d1d31f44366d P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:25.469321 29561 ts_tablet_manager.cc:1929] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:25.473467 29561 log.cc:1199] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/c213348428a04c479f871d390b7e3c95
I20260928 07:56:25.474584 29561 ts_tablet_manager.cc:1950] T c213348428a04c479f871d390b7e3c95 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:25.454366 29583 tablet.cc:1751] T 9eaff4ec62804f00a750d1d31f44366d P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:25.484462 27815 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet c213348428a04c479f871d390b7e3c95 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]) successfully deleted
I20260928 07:56:25.527894 29555 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "b64b51f6f084474eb360161ac99f9b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:25.528640 29555 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16 [sys.catalog]: This master's current role is: LEADER
I20260928 07:56:25.571357 29213 catalog_manager.cc:5838] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:25.573015 29213 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 5c670de5690141bea18b9a07d1e950d4 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:25.575289 27820 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]
I20260928 07:56:25.576604 27820 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 144) took 6785 ms. Trace:
I20260928 07:56:25.576911 27820 rpcz_store.cc:276] 0928 07:56:18.791312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.792368 (+ 1056us) service_pool.cc:224] Handling call
0928 07:56:25.191368 (+6399000us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:25.576514 (+385146us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":11537,"Hive Metastore.run_cpu_time_us":435,"Hive Metastore.run_wall_time_us":370845}
I20260928 07:56:25.580133 29213 catalog_manager.cc:5838] T 2de0f3ba82a4442588cbb547f3cf9881 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } }
W20260928 07:56:25.211719 28556 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.221.254:36357)
W20260928 07:56:25.598999 28556 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.CreateTable -> {remote=127.26.221.254:36357, user_credentials={real_user=slave}} blocked reactor thread for 393950us
W20260928 07:56:25.614734 28556 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.26.221.252:41205)
I20260928 07:56:25.620281 29209 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ad8656a1c06494b9ebc9eb2e9512b41 from {username='slave'} at 127.0.0.1:38488
I20260928 07:56:25.650862 29576 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b64b51f6f084474eb360161ac99f9b16)
I20260928 07:56:25.651575 29576 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:25.676805 29586 tablet.cc:1751] T 9eaff4ec62804f00a750d1d31f44366d P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:25.598138 29216 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38488:
name: "default.Table_cc618d40e945497e85e73c63ae4b6bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:25.618726 29212 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38488:
name: "default.Table_34c72cbfe84d4e0397aee47a3f75b67a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:25.712181 29415 catalog_manager.cc:2811] Deleting table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072] in response to Hive Metastore notification log event 49
I20260928 07:56:25.716847 28253 heartbeater.cc:499] Master 127.26.221.252:41205 was elected leader, sending a full tablet report...
I20260928 07:56:25.714171 29209 catalog_manager.cc:6133] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Sending DeleteTablet for 3 replicas of tablet 8ad8656a1c06494b9ebc9eb2e9512b41
I20260928 07:56:25.747220 29209 catalog_manager.cc:6934] ReplaceTablet: tablet 8ad8656a1c06494b9ebc9eb2e9512b41 deleted and replaced by tablet 7d2d09a0cf79421dbc71a32fb55b1e25
I20260928 07:56:25.780309 28187 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2d09a0cf79421dbc71a32fb55b1e25) from {username='slave'} at 127.0.0.1:50024
I20260928 07:56:25.812983 29415 catalog_manager.cc:6133] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: Sending DeleteTablet for 3 replicas of tablet 3e15ae22ba5d46c09b1cc9d99dce8b38
I20260928 07:56:25.815936 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:25 UTC) from {username='slave'} at 127.0.0.1:50024
W20260928 07:56:25.817456 29216 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cc618d40e945497e85e73c63ae4b6bd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:25.834506 28329 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2d09a0cf79421dbc71a32fb55b1e25) from {username='slave'} at 127.0.0.1:41170
I20260928 07:56:25.835886 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:25 UTC) from {username='slave'} at 127.0.0.1:41170
I20260928 07:56:25.836637 29561 tablet_replica.cc:333] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:25.838909 29561 raft_consensus.cc:2243] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:25.839012 29594 tablet_replica.cc:333] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:25.839596 29561 raft_consensus.cc:2272] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:25.839950 29594 raft_consensus.cc:2243] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:25.840905 29594 raft_consensus.cc:2272] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:25.851698 29594 ts_tablet_manager.cc:1916] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:25.866080 29561 ts_tablet_manager.cc:1916] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:25.867921 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (DEFAULT_TABLE table=default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:25.868960 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2d09a0cf79421dbc71a32fb55b1e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:25.874176 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (DEFAULT_TABLE table=default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:25.875404 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2d09a0cf79421dbc71a32fb55b1e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:25.895375 28185 tablet_service.cc:1511] Processing CreateTablet for tablet d4fa2c780a744b30be854f00223cb472 (DEFAULT_TABLE table=default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:25.896514 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4fa2c780a744b30be854f00223cb472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:25.897514 28329 tablet_service.cc:1511] Processing CreateTablet for tablet d4fa2c780a744b30be854f00223cb472 (DEFAULT_TABLE table=default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:25.898644 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4fa2c780a744b30be854f00223cb472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:25.926268 28184 tablet_service.cc:1511] Processing CreateTablet for tablet fa4546b980894e68bb371bdda05058b6 (DEFAULT_TABLE table=default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:25.927464 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4546b980894e68bb371bdda05058b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:25.940073 29209 catalog_manager.cc:5838] T 62bc065c9f2743c9ae79dc37bc6de0c2 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 1 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } }
I20260928 07:56:25.944891 28327 tablet_service.cc:1511] Processing CreateTablet for tablet fa4546b980894e68bb371bdda05058b6 (DEFAULT_TABLE table=default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:25.946230 28327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4546b980894e68bb371bdda05058b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:25.995056 29209 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 5c670de5690141bea18b9a07d1e950d4 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:25.997113 29209 catalog_manager.cc:5838] T 34a0cf784aee4d0e9b7b269182ba7de3 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:26.020081 29596 tablet_bootstrap.cc:492] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:26.018612 29209 catalog_manager.cc:5838] T 9e5a4815e0004b5e827e30ccbe9073f1 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 1 to 2, leader changed from acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193) to bae11841a62f429a98a978de5b7bd60e (127.26.221.195). New cstate: current_term: 2 leader_uuid: "bae11841a62f429a98a978de5b7bd60e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } }
I20260928 07:56:26.030961 29213 catalog_manager.cc:6391] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: default.table_da656d08cd28419b8599a14b3946a15a [id=7d3bf1f44d9443b78713cb43948ae519] alter complete (version 1)
I20260928 07:56:26.035494 28397 heartbeater.cc:499] Master 127.26.221.252:41205 was elected leader, sending a full tablet report...
I20260928 07:56:26.074476 29596 tablet_bootstrap.cc:654] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:26.082536 29595 tablet_bootstrap.cc:492] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:26.106871 29561 ts_tablet_manager.cc:1929] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:26.107328 29561 log.cc:1199] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/8ad8656a1c06494b9ebc9eb2e9512b41
I20260928 07:56:26.108117 29561 ts_tablet_manager.cc:1950] T 8ad8656a1c06494b9ebc9eb2e9512b41 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
I20260928 07:56:26.112711 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 8 candidate_status { last_received { term: 7 index: 275 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:26.067867 29594 ts_tablet_manager.cc:1929] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:26.117601 29594 log.cc:1199] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/8ad8656a1c06494b9ebc9eb2e9512b41
I20260928 07:56:26.118577 29594 ts_tablet_manager.cc:1950] T 8ad8656a1c06494b9ebc9eb2e9512b41 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:26.121680 29137 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 8ad8656a1c06494b9ebc9eb2e9512b41 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:26.125360 29594 tablet_replica.cc:333] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: stopping tablet replica
I20260928 07:56:26.126284 29594 raft_consensus.cc:2243] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:26.133107 29561 tablet_replica.cc:333] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: stopping tablet replica
I20260928 07:56:26.133512 29137 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 8ad8656a1c06494b9ebc9eb2e9512b41 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:26.133847 29595 tablet_bootstrap.cc:654] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:26.133747 29594 raft_consensus.cc:2272] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:26.136988 29594 ts_tablet_manager.cc:1916] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:26.129276 29213 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 5c670de5690141bea18b9a07d1e950d4 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
I20260928 07:56:26.148231 29213 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:26.150949 29213 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]). Expected version 1 got 0
I20260928 07:56:26.134640 29561 raft_consensus.cc:2243] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Raft consensus shutting down.
I20260928 07:56:26.154361 29561 raft_consensus.cc:2272] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:26.156698 29561 ts_tablet_manager.cc:1916] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:26.162343 29576 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:26.158587 29238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 8 candidate_status { last_received { term: 7 index: 275 } } ignore_live_leader: false dest_uuid: "b64b51f6f084474eb360161ac99f9b16" is_pre_election: true
I20260928 07:56:26.164255 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:26.207226 28185 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2d09a0cf79421dbc71a32fb55b1e25) from {username='slave'} at 127.0.0.1:50024
I20260928 07:56:26.215340 29216 catalog_manager.cc:2213] created HMS catalog entry for table [id=bf58ecfe97d24b4792838142aae14f6c]
W20260928 07:56:26.221900 29213 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d4fa2c780a744b30be854f00223cb472 consensus state has no leader
I20260928 07:56:26.224404 28331 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2d09a0cf79421dbc71a32fb55b1e25) from {username='slave'} at 127.0.0.1:41170
I20260928 07:56:26.227382 29594 ts_tablet_manager.cc:1929] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 07:56:26.234338 29213 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7d2d09a0cf79421dbc71a32fb55b1e25 consensus state has no leader
I20260928 07:56:26.238982 29594 log.cc:1199] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-0/wal/wals/3e15ae22ba5d46c09b1cc9d99dce8b38
I20260928 07:56:26.243532 29594 ts_tablet_manager.cc:1950] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P acdaa3cf2ffd45f5b55a169c1bacead5: Deleting consensus metadata
I20260928 07:56:26.246387 28544 heartbeater.cc:499] Master 127.26.221.252:41205 was elected leader, sending a full tablet report...
I20260928 07:56:26.245499 29596 tablet_bootstrap.cc:492] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:26.249074 29596 ts_tablet_manager.cc:1403] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.229s user 0.019s sys 0.012s
I20260928 07:56:26.249941 29137 catalog_manager.cc:5063] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
W20260928 07:56:26.265781 29132 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d4fa2c780a744b30be854f00223cb472 consensus state has no leader
I20260928 07:56:26.272495 29596 raft_consensus.cc:359] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.273469 29561 ts_tablet_manager.cc:1929] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:26.273962 29596 raft_consensus.cc:385] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:26.274425 29561 log.cc:1199] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-1/wal/wals/3e15ae22ba5d46c09b1cc9d99dce8b38
W20260928 07:56:26.275247 28540 debug-util.cc:398] Leaking SignalData structure 0x7b0800125ea0 after lost signal to thread 28409
I20260928 07:56:26.285300 29596 raft_consensus.cc:740] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:26.286442 29561 ts_tablet_manager.cc:1950] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P 3bd67de620c94af3b7c8e3ba7d42f980: Deleting consensus metadata
W20260928 07:56:26.288995 29137 catalog_manager.cc:5030] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): delete failed for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 because the tablet was not found. No further retry: Not found: Tablet not found: 8ad8656a1c06494b9ebc9eb2e9512b41
I20260928 07:56:26.290040 29596 consensus_queue.cc:260] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.325742 29596 ts_tablet_manager.cc:1434] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.076s user 0.007s sys 0.000s
I20260928 07:56:26.308933 29137 catalog_manager.cc:5063] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
W20260928 07:56:26.333487 29137 catalog_manager.cc:5030] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035): delete failed for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 because the tablet was not found. No further retry: Not found: Tablet not found: 8ad8656a1c06494b9ebc9eb2e9512b41
I20260928 07:56:26.333528 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 3e321ad85a4e488cb28c4b63be927342 (DEFAULT_TABLE table=default.table_cc618d40e945497e85e73c63ae4b6bd5 [id=bf58ecfe97d24b4792838142aae14f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:26.334546 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e321ad85a4e488cb28c4b63be927342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:26.357959 29596 tablet_bootstrap.cc:492] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:26.365537 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 3e321ad85a4e488cb28c4b63be927342 (DEFAULT_TABLE table=default.table_cc618d40e945497e85e73c63ae4b6bd5 [id=bf58ecfe97d24b4792838142aae14f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:26.366722 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e321ad85a4e488cb28c4b63be927342. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 07:56:26.375434 28435 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.629s user 0.006s sys 0.011s
W20260928 07:56:26.375819 28435 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.630s user 0.006s sys 0.011s
I20260928 07:56:26.405411 27825 catalog_manager.cc:3541] renamed table default.table_c8c37153157644cba24992442f231936 [id=209eb88d159b41809555701a991da647] in HMS: new name default.table_1f78a84fc89e458e8b34bcaa23bdc72d
I20260928 07:56:26.407263 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ad8656a1c06494b9ebc9eb2e9512b41 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2d09a0cf79421dbc71a32fb55b1e25) from {username='slave'} at 127.0.0.1:49160
I20260928 07:56:26.409377 27825 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51542 (request call id 145) took 7614 ms. Trace:
I20260928 07:56:26.409884 27825 rpcz_store.cc:276] 0928 07:56:18.794534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:18.794659 (+ 125us) service_pool.cc:224] Handling call
0928 07:56:25.192516 (+6397857us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:26.406747 (+1214231us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:26.408286 (+ 1539us) catalog_manager.cc:3764] Apply alter schema
0928 07:56:26.409303 (+ 1017us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":381383,"Hive Metastore.run_cpu_time_us":2104,"Hive Metastore.run_wall_time_us":830030}
I20260928 07:56:26.412746 29610 tablet_replica.cc:333] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:26.414203 29610 raft_consensus.cc:2243] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:26.415108 29610 raft_consensus.cc:2272] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:26.418591 29610 ts_tablet_manager.cc:1916] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:26.421643 29607 tablet.cc:1751] T 5c670de5690141bea18b9a07d1e950d4 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:26.428485 29595 tablet_bootstrap.cc:492] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:26.429072 29595 ts_tablet_manager.cc:1403] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.347s user 0.041s sys 0.088s
I20260928 07:56:26.404476 29609 tablet.cc:1751] T 5c670de5690141bea18b9a07d1e950d4 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:26.431823 29595 raft_consensus.cc:359] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:26.436955 29595 raft_consensus.cc:385] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:26.438359 29595 raft_consensus.cc:740] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:26.443224 29595 consensus_queue.cc:260] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:26.451046 29595 ts_tablet_manager.cc:1434] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.022s user 0.004s sys 0.002s
I20260928 07:56:26.455523 29595 tablet_bootstrap.cc:492] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:26.457114 29213 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]). Expected version 1 got 0
I20260928 07:56:26.466746 29595 tablet_bootstrap.cc:654] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:26.478144 29213 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]). Expected version 1 got 0
I20260928 07:56:26.497387 29596 tablet_bootstrap.cc:700] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent opening tablet: real 0.116s user 0.004s sys 0.000s
I20260928 07:56:26.498344 29596 tablet_bootstrap.cc:654] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:26.427886 29586 tablet.cc:1751] T 5c670de5690141bea18b9a07d1e950d4 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:26.431581 28479 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 07:56:25 UTC) from {username='slave'} at 127.0.0.1:49160
I20260928 07:56:26.433152 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (DEFAULT_TABLE table=default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:26.542514 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2d09a0cf79421dbc71a32fb55b1e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:26.434923 28477 tablet_service.cc:1511] Processing CreateTablet for tablet d4fa2c780a744b30be854f00223cb472 (DEFAULT_TABLE table=default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:26.545197 29595 tablet_bootstrap.cc:492] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:26.545704 29595 ts_tablet_manager.cc:1403] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.090s user 0.026s sys 0.020s
I20260928 07:56:26.546222 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4fa2c780a744b30be854f00223cb472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:26.437664 28476 tablet_service.cc:1511] Processing CreateTablet for tablet fa4546b980894e68bb371bdda05058b6 (DEFAULT_TABLE table=default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:26.548125 28476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4546b980894e68bb371bdda05058b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:26.440996 28475 tablet_service.cc:1511] Processing CreateTablet for tablet 3e321ad85a4e488cb28c4b63be927342 (DEFAULT_TABLE table=default.table_cc618d40e945497e85e73c63ae4b6bd5 [id=bf58ecfe97d24b4792838142aae14f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:26.548681 29595 raft_consensus.cc:359] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.549417 29595 raft_consensus.cc:385] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:26.549669 29595 raft_consensus.cc:740] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:26.549718 28475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e321ad85a4e488cb28c4b63be927342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:26.553105 29595 consensus_queue.cc:260] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.559758 29595 ts_tablet_manager.cc:1434] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260928 07:56:26.560743 29595 tablet_bootstrap.cc:492] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:26.566944 29595 tablet_bootstrap.cc:654] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:26.583220 29596 tablet_bootstrap.cc:492] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:26.583804 29596 ts_tablet_manager.cc:1403] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.226s user 0.013s sys 0.000s
I20260928 07:56:26.586702 29596 raft_consensus.cc:359] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.611272 29216 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 5c670de5690141bea18b9a07d1e950d4 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]). Expected version 1 got 0
W20260928 07:56:26.619006 29212 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_34c72cbfe84d4e0397aee47a3f75b67a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 07:56:26.637750 29595 tablet_bootstrap.cc:492] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:26.638324 29595 ts_tablet_manager.cc:1403] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.078s user 0.035s sys 0.017s
I20260928 07:56:26.645903 29595 raft_consensus.cc:359] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.646705 29595 raft_consensus.cc:385] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:26.647015 29595 raft_consensus.cc:740] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:26.647754 29595 consensus_queue.cc:260] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.652526 29595 ts_tablet_manager.cc:1434] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.009s user 0.004s sys 0.001s
I20260928 07:56:26.657297 29595 tablet_bootstrap.cc:492] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:26.676340 29595 tablet_bootstrap.cc:654] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:26.681862 29576 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260928 07:56:26.723320 29607 tablet.cc:1751] T 8a991fd5fd32408ba8e1065a855b06d3 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:26.763196 29209 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:26.775691 29586 tablet.cc:1751] T 8a991fd5fd32408ba8e1065a855b06d3 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:26.801083 29596 raft_consensus.cc:385] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:26.801568 29596 raft_consensus.cc:740] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:26.804409 29621 tablet_bootstrap.cc:492] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:26.807176 29609 tablet.cc:1751] T 8a991fd5fd32408ba8e1065a855b06d3 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:26.808420 29595 tablet_bootstrap.cc:492] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:26.808920 29595 ts_tablet_manager.cc:1403] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.152s user 0.018s sys 0.028s
I20260928 07:56:26.811926 29595 raft_consensus.cc:359] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.812667 29595 raft_consensus.cc:385] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:26.812960 29595 raft_consensus.cc:740] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:26.821857 29621 tablet_bootstrap.cc:654] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:26.822099 29595 consensus_queue.cc:260] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.833827 29595 ts_tablet_manager.cc:1434] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.025s user 0.008s sys 0.000s
I20260928 07:56:26.853483 29596 consensus_queue.cc:260] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.886524 29213 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:26.922477 29209 catalog_manager.cc:6391] T 00000000000000000000000000000000 P b64b51f6f084474eb360161ac99f9b16: default.table_1f78a84fc89e458e8b34bcaa23bdc72d [id=209eb88d159b41809555701a991da647] alter complete (version 1)
I20260928 07:56:26.932643 29455 raft_consensus.cc:493] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:26.933184 29455 raft_consensus.cc:515] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:26.943431 29596 ts_tablet_manager.cc:1434] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.359s user 0.007s sys 0.000s
I20260928 07:56:26.953663 29551 raft_consensus.cc:493] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:26.954653 29551 raft_consensus.cc:515] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:26.958600 29551 leader_election.cc:290] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:26.963413 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4546b980894e68bb371bdda05058b6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:26.964093 28346 raft_consensus.cc:2468] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
W20260928 07:56:26.964967 28141 leader_election.cc:343] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Not found: Tablet not found: fa4546b980894e68bb371bdda05058b6
I20260928 07:56:26.965946 28142 leader_election.cc:304] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:26.966653 29551 raft_consensus.cc:2804] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:26.967048 29551 raft_consensus.cc:493] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:26.967449 29551 raft_consensus.cc:3060] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:26.972748 29209 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:26.975757 29621 tablet_bootstrap.cc:492] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:26.976238 29621 ts_tablet_manager.cc:1403] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.172s user 0.011s sys 0.000s
I20260928 07:56:26.996639 29621 raft_consensus.cc:359] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.003566 29621 raft_consensus.cc:385] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:27.003927 29621 raft_consensus.cc:740] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:27.013276 29596 tablet_bootstrap.cc:492] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:27.013754 29621 consensus_queue.cc:260] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.023870 29621 ts_tablet_manager.cc:1434] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.047s user 0.008s sys 0.000s
I20260928 07:56:27.039646 29443 raft_consensus.cc:493] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:27.040155 29443 raft_consensus.cc:515] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.043735 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2d09a0cf79421dbc71a32fb55b1e25" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:27.055234 29455 leader_election.cc:290] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:27.058103 29443 leader_election.cc:290] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
W20260928 07:56:27.062340 28286 leader_election.cc:343] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:27.064759 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e321ad85a4e488cb28c4b63be927342" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
W20260928 07:56:27.067284 28286 leader_election.cc:343] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:27.088969 29596 tablet_bootstrap.cc:654] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:27.145658 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e321ad85a4e488cb28c4b63be927342" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:27.154404 28497 raft_consensus.cc:2468] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
W20260928 07:56:27.157240 28285 leader_election.cc:343] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Not found: Tablet not found: 7d2d09a0cf79421dbc71a32fb55b1e25
I20260928 07:56:27.157727 28285 leader_election.cc:304] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980; no voters: acdaa3cf2ffd45f5b55a169c1bacead5, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:27.159651 28285 leader_election.cc:304] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:27.162657 29443 raft_consensus.cc:2749] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:27.164587 29443 raft_consensus.cc:2804] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:27.164948 29443 raft_consensus.cc:493] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:27.167527 29443 raft_consensus.cc:3060] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.189054 29443 raft_consensus.cc:515] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.194504 29621 tablet_bootstrap.cc:492] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:27.201758 29621 tablet_bootstrap.cc:654] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:27.216672 29621 tablet_bootstrap.cc:492] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:27.217515 29621 ts_tablet_manager.cc:1403] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.006s
I20260928 07:56:27.036994 29551 raft_consensus.cc:515] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.220674 29551 leader_election.cc:290] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:27.193270 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e321ad85a4e488cb28c4b63be927342" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
W20260928 07:56:27.223065 28286 leader_election.cc:343] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:27.224640 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4546b980894e68bb371bdda05058b6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:27.226104 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4546b980894e68bb371bdda05058b6" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:27.226676 28346 raft_consensus.cc:3060] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.228531 29610 ts_tablet_manager.cc:1929] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 07:56:27.228962 29610 log.cc:1199] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/8ad8656a1c06494b9ebc9eb2e9512b41
W20260928 07:56:27.232146 28141 leader_election.cc:343] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:27.234579 28346 raft_consensus.cc:2468] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:27.235894 28142 leader_election.cc:304] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:27.236984 29551 raft_consensus.cc:2804] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:27.237457 29551 raft_consensus.cc:697] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:27.238250 29551 consensus_queue.cc:237] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.240365 29212 catalog_manager.cc:2213] created HMS catalog entry for table [id=314da4c670c14fba843c4688089189c5]
I20260928 07:56:27.240865 27822 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18]
I20260928 07:56:27.242626 27822 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51542 (request call id 146) took 8446 ms. Trace:
I20260928 07:56:27.242928 27822 rpcz_store.cc:276] 0928 07:56:18.796041 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:19.016756 (+220715us) service_pool.cc:224] Handling call
0928 07:56:25.193569 (+6176813us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 07:56:27.242556 (+2048987us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1210827,"Hive Metastore.run_cpu_time_us":367,"Hive Metastore.run_wall_time_us":835040}
I20260928 07:56:27.243404 29623 raft_consensus.cc:493] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:27.243860 29623 raft_consensus.cc:515] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.250319 29623 leader_election.cc:290] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:27.257629 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fa2c780a744b30be854f00223cb472" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:27.258049 29443 leader_election.cc:290] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:27.258333 28347 raft_consensus.cc:2468] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:27.259649 28142 leader_election.cc:304] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:27.260578 29623 raft_consensus.cc:2804] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:27.260967 29623 raft_consensus.cc:493] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:27.261070 29212 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38488 (request call id 3) took 1643 ms. Trace:
I20260928 07:56:27.261389 29623 raft_consensus.cc:3060] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.261458 29212 rpcz_store.cc:276] 0928 07:56:25.618116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:25.618253 (+ 137us) service_pool.cc:224] Handling call
0928 07:56:26.621232 (+1002979us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:26.623073 (+ 1841us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:27.240293 (+617220us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:27.260311 (+ 20018us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 07:56:27.260732 (+ 421us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 07:56:27.261006 (+ 274us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:27.242110 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 07:56:27.242598 (+ 488us) write_op.cc:432] Acquiring schema lock in shared mode
0928 07:56:27.242627 (+ 29us) write_op.cc:435] Acquired schema lock
0928 07:56:27.242643 (+ 16us) tablet.cc:662] Decoding operations
0928 07:56:27.242952 (+ 309us) write_op.cc:620] Acquiring the partition lock for write op
0928 07:56:27.242998 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0928 07:56:27.243019 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 07:56:27.243273 (+ 254us) tablet.cc:701] Row locks acquired
0928 07:56:27.243289 (+ 16us) write_op.cc:260] PREPARE: finished
0928 07:56:27.243456 (+ 167us) write_op.cc:270] Start()
0928 07:56:27.243558 (+ 102us) write_op.cc:276] Timestamp: P: 1790582187243376 usec, L: 0
0928 07:56:27.243578 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 07:56:27.244135 (+ 557us) log.cc:844] Serialized 433 byte log entry
0928 07:56:27.256074 (+ 11939us) op_driver.cc:464] REPLICATION: finished
0928 07:56:27.256476 (+ 402us) write_op.cc:301] APPLY: starting
0928 07:56:27.256535 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 07:56:27.256642 (+ 107us) tablet.cc:1397] finished BulkCheckPresence
0928 07:56:27.256738 (+ 96us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 07:56:27.257144 (+ 406us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 07:56:27.257301 (+ 157us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 07:56:27.257352 (+ 51us) write_op.cc:312] APPLY: finished
0928 07:56:27.257544 (+ 192us) log.cc:844] Serialized 29 byte log entry
0928 07:56:27.257684 (+ 140us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:27.257752 (+ 68us) write_op.cc:454] Released schema lock
0928 07:56:27.257782 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 07:56:27.257997 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:27.258024 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1902,"Hive Metastore.run_cpu_time_us":758,"Hive Metastore.run_wall_time_us":614591,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":1495,"apply.run_wall_time_us":1494,"num_ops":2,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":2427,"prepare.run_wall_time_us":2427,"raft.queue_time_us":2880,"raft.run_cpu_time_us":1740,"raft.run_wall_time_us":1740,"replication_time_us":12378}]]}
I20260928 07:56:27.235359 29621 raft_consensus.cc:359] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.285439 29621 raft_consensus.cc:385] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:27.285828 29621 raft_consensus.cc:740] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:27.286645 29621 consensus_queue.cc:260] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.251725 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fa2c780a744b30be854f00223cb472" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:27.259661 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e321ad85a4e488cb28c4b63be927342" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:27.288447 28494 raft_consensus.cc:3060] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
W20260928 07:56:27.293929 28141 leader_election.cc:343] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:27.294598 29623 raft_consensus.cc:515] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.297331 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fa2c780a744b30be854f00223cb472" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:27.297873 28347 raft_consensus.cc:3060] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.320794 28347 raft_consensus.cc:2468] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:27.321645 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 21ab26a3171e454498852530ac879e6c (DEFAULT_TABLE table=default.table_34c72cbfe84d4e0397aee47a3f75b67a [id=314da4c670c14fba843c4688089189c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:27.322039 28142 leader_election.cc:304] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:27.322628 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ab26a3171e454498852530ac879e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:27.331338 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fa2c780a744b30be854f00223cb472" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:27.332849 28141 leader_election.cc:343] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:27.335367 29623 leader_election.cc:290] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:27.335899 29623 raft_consensus.cc:2804] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:27.336298 29623 raft_consensus.cc:697] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:27.338294 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 21ab26a3171e454498852530ac879e6c (DEFAULT_TABLE table=default.table_34c72cbfe84d4e0397aee47a3f75b67a [id=314da4c670c14fba843c4688089189c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:27.339497 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ab26a3171e454498852530ac879e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:27.337100 29623 consensus_queue.cc:237] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.342316 29621 ts_tablet_manager.cc:1434] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.124s user 0.006s sys 0.000s
I20260928 07:56:27.343554 29621 tablet_bootstrap.cc:492] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:27.357384 28331 tablet_service.cc:1511] Processing CreateTablet for tablet 21ab26a3171e454498852530ac879e6c (DEFAULT_TABLE table=default.table_34c72cbfe84d4e0397aee47a3f75b67a [id=314da4c670c14fba843c4688089189c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 07:56:27.358440 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ab26a3171e454498852530ac879e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 07:56:27.370558 28494 raft_consensus.cc:2468] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:27.371915 28285 leader_election.cc:304] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e; no voters: acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:27.372996 29443 raft_consensus.cc:2804] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:27.373474 29443 raft_consensus.cc:697] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:27.374290 29443 consensus_queue.cc:237] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
W20260928 07:56:27.390980 29132 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d4fa2c780a744b30be854f00223cb472 consensus state has no leader
I20260928 07:56:27.400192 29212 catalog_manager.cc:5838] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:27.407382 29621 tablet_bootstrap.cc:654] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:27.416460 29596 tablet_bootstrap.cc:492] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:27.416893 29596 ts_tablet_manager.cc:1403] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.404s user 0.010s sys 0.001s
I20260928 07:56:27.420085 29596 raft_consensus.cc:359] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.420755 29596 raft_consensus.cc:385] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:27.421020 29596 raft_consensus.cc:740] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:27.421773 29596 consensus_queue.cc:260] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.424022 29596 ts_tablet_manager.cc:1434] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260928 07:56:27.428390 29596 tablet_bootstrap.cc:492] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:27.434132 29596 tablet_bootstrap.cc:654] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:27.440107 29209 catalog_manager.cc:5838] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:27.456445 29635 tablet_bootstrap.cc:492] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980: Bootstrap starting.
I20260928 07:56:27.460927 29596 tablet_bootstrap.cc:492] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:27.461500 29596 ts_tablet_manager.cc:1403] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.003s
I20260928 07:56:27.464464 29596 raft_consensus.cc:359] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.470855 29596 raft_consensus.cc:385] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:27.471311 29596 raft_consensus.cc:740] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:27.475417 29610 ts_tablet_manager.cc:1950] T 8ad8656a1c06494b9ebc9eb2e9512b41 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:27.475291 29596 consensus_queue.cc:260] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.483528 29610 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49160 (request call id 0) took 1106 ms. Trace:
I20260928 07:56:27.490163 29596 ts_tablet_manager.cc:1434] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260928 07:56:27.508760 29635 tablet_bootstrap.cc:654] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:27.509768 29596 tablet_bootstrap.cc:492] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5: Bootstrap starting.
I20260928 07:56:27.484055 29610 rpcz_store.cc:276] 0928 07:56:26.377394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:26.406976 (+ 29582us) service_pool.cc:224] Handling call
0928 07:56:26.412410 (+ 5434us) ts_tablet_manager.cc:1151] Deleting tablet 8ad8656a1c06494b9ebc9eb2e9512b41
0928 07:56:26.412483 (+ 73us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:27.042633 (+630150us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:27.228404 (+185771us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:27.483437 (+255033us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4559,"thread_start_us":8726,"threads_started":1}
I20260928 07:56:27.518802 29133 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 8ad8656a1c06494b9ebc9eb2e9512b41 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]) successfully deleted
I20260928 07:56:27.521508 29621 tablet_bootstrap.cc:492] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:27.524340 29596 tablet_bootstrap.cc:654] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:27.524106 29216 catalog_manager.cc:5838] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:27.524389 29621 ts_tablet_manager.cc:1403] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.181s user 0.013s sys 0.000s
I20260928 07:56:27.525513 29216 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:27.526190 29216 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]). Expected version 1 got 0
I20260928 07:56:27.531389 29621 raft_consensus.cc:359] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.539072 29596 tablet_bootstrap.cc:492] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5: No bootstrap required, opened a new log
I20260928 07:56:27.539534 29596 ts_tablet_manager.cc:1403] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.003s
I20260928 07:56:27.542259 29596 raft_consensus.cc:359] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.542946 29596 raft_consensus.cc:385] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:27.543226 29596 raft_consensus.cc:740] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Initialized, Role: FOLLOWER
I20260928 07:56:27.536378 29610 tablet_replica.cc:333] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: stopping tablet replica
I20260928 07:56:27.547763 29610 raft_consensus.cc:2243] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 07:56:27.548429 29610 raft_consensus.cc:2272] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 07:56:27.556286 29610 ts_tablet_manager.cc:1916] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 07:56:27.561519 29621 raft_consensus.cc:385] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:27.564146 29621 raft_consensus.cc:740] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:27.565817 29635 tablet_bootstrap.cc:492] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980: No bootstrap required, opened a new log
I20260928 07:56:27.566287 29635 ts_tablet_manager.cc:1403] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent bootstrapping tablet: real 0.110s user 0.019s sys 0.002s
I20260928 07:56:27.569761 29635 raft_consensus.cc:359] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.570986 29635 raft_consensus.cc:385] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:27.567030 29621 consensus_queue.cc:260] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.571733 29635 raft_consensus.cc:740] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Initialized, Role: FOLLOWER
I20260928 07:56:27.570665 29596 consensus_queue.cc:260] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.572651 29635 consensus_queue.cc:260] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.574874 29596 ts_tablet_manager.cc:1434] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5: Time spent starting tablet: real 0.035s user 0.002s sys 0.004s
I20260928 07:56:27.611119 29608 raft_consensus.cc:493] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:27.611606 29608 raft_consensus.cc:515] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.614156 29608 leader_election.cc:290] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:27.624557 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4546b980894e68bb371bdda05058b6" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:27.625379 28347 raft_consensus.cc:2393] T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:27.627602 29635 ts_tablet_manager.cc:1434] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980: Time spent starting tablet: real 0.061s user 0.004s sys 0.002s
I20260928 07:56:27.630474 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4546b980894e68bb371bdda05058b6" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:27.632077 28434 leader_election.cc:304] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:27.639468 29608 raft_consensus.cc:3060] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.657681 29209 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:27.691116 29608 raft_consensus.cc:2749] T fa4546b980894e68bb371bdda05058b6 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:27.704897 27827 catalog_manager.cc:2213] created HMS catalog entry for table [id=d4c1748ce57c4d42b5bcc0de6bf1177c]
W20260928 07:56:27.707043 27827 catalog_manager.cc:2241] Illegal state: an error occurred while writing to the sys-catalog: replica dfb6604d9ebb423090c878c2b1db0cab is not leader of this config: current role FOLLOWER
F20260928 07:56:27.706630 29415 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 52, previous 52; dumping first 2 out of 3 received events: NotificationEvent(eventId=52, eventTime=1790582187, eventType=DROP_TABLE, dbName=default, tableName=table_2a0111dbc5c34f6e9adeaff86b2c2769, message={"server":"","servicePrincipal":"","db":"default","table":"table_2a0111dbc5c34f6e9adeaff86b2c2769","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2a0111dbc5c34f6e9adeaff86b2c2769\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790582178},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/warehouse/table_2a0111dbc5c34f6e9adeaff86b2c2769\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2a0111dbc5c34f6e9adeaff86b2c2769\",\"kudu.table_id\":\"0485a22c767b4bcf9cf4424064408d18\",\"transient_lastDdlTime\":\"1790582178\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205\",\"kudu.cluster_id\":\"9ec5f5a0ebfb4a28993124d3fd7060b5\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790582187}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=52, eventTime=1790582187, eventType=CREATE_TABLE, dbName=default, tableName=table_34c72cbfe84d4e0397aee47a3f75b67a, message={"server":"","servicePrincipal":"","db":"default","table":"table_34c72cbfe84d4e0397aee47a3f75b67a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34c72cbfe84d4e0397aee47a3f75b67a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790582186},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/warehouse/table_34c72cbfe84d4e0397aee47a3f75b67a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34c72cbfe84d4e0397aee47a3f75b67a\",\"kudu.table_id\":\"314da4c670c14fba843c4688089189c5\",\"transient_lastDdlTime\":\"1790582186\",\"comment\":\"\",\"kudu.master_addresses\":\"127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9ec5f5a0ebfb4a28993124d3fd7060b5\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790582187,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260928 07:56:27.710105 29621 ts_tablet_manager.cc:1434] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.185s user 0.007s sys 0.000s
I20260928 07:56:27.720831 29621 tablet_bootstrap.cc:492] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:27.726867 29621 tablet_bootstrap.cc:654] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:27.712486 29639 raft_consensus.cc:493] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:27.729522 29639 raft_consensus.cc:515] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:27.732329 29639 leader_election.cc:290] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:27.733465 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fa2c780a744b30be854f00223cb472" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:27.735471 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fa2c780a744b30be854f00223cb472" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:27.736275 28347 raft_consensus.cc:2393] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in this term.
I20260928 07:56:27.737917 28434 leader_election.cc:304] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:27.751001 29640 raft_consensus.cc:3060] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.754927 29216 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:27.776033 29443 raft_consensus.cc:493] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:27.776532 29443 raft_consensus.cc:515] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.778604 29443 leader_election.cc:290] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:27.779421 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab26a3171e454498852530ac879e6c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:27.780033 28207 raft_consensus.cc:2468] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 0.
I20260928 07:56:27.781530 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab26a3171e454498852530ac879e6c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:27.781984 28286 leader_election.cc:304] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
W20260928 07:56:27.783406 28285 leader_election.cc:343] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
I20260928 07:56:27.784451 29443 raft_consensus.cc:2804] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:27.784936 29443 raft_consensus.cc:493] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:27.785427 29443 raft_consensus.cc:3060] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.789872 29610 ts_tablet_manager.cc:1929] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 07:56:27.790328 29610 log.cc:1199] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: Deleting WAL directory at /tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/ts-2/wal/wals/3e15ae22ba5d46c09b1cc9d99dce8b38
I20260928 07:56:27.794039 29443 raft_consensus.cc:515] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.801932 29610 ts_tablet_manager.cc:1950] T 3e15ae22ba5d46c09b1cc9d99dce8b38 P bae11841a62f429a98a978de5b7bd60e: Deleting consensus metadata
I20260928 07:56:27.804762 29621 tablet_bootstrap.cc:492] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:27.805349 29621 ts_tablet_manager.cc:1403] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.085s user 0.018s sys 0.056s
I20260928 07:56:27.805739 29623 raft_consensus.cc:493] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:27.806250 29623 raft_consensus.cc:515] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.808264 29623 leader_election.cc:290] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:27.808353 29621 raft_consensus.cc:359] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.810144 28207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab26a3171e454498852530ac879e6c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5"
I20260928 07:56:27.810658 28207 raft_consensus.cc:3060] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.810995 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2d09a0cf79421dbc71a32fb55b1e25" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:27.813984 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2d09a0cf79421dbc71a32fb55b1e25" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:27.814592 28347 raft_consensus.cc:2468] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:27.814618 29610 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49160 (request call id 1) took 1385 ms. Trace:
I20260928 07:56:27.814970 29610 rpcz_store.cc:276] 0928 07:56:26.429060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:26.431413 (+ 2353us) service_pool.cc:224] Handling call
0928 07:56:27.514363 (+1082950us) ts_tablet_manager.cc:1151] Deleting tablet 3e15ae22ba5d46c09b1cc9d99dce8b38
0928 07:56:27.536205 (+ 21842us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 07:56:27.699333 (+163128us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:27.789711 (+ 90378us) tablet_metadata.cc:665] Metadata flushed
0928 07:56:27.814544 (+ 24833us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":973412}
I20260928 07:56:27.815938 27828 catalog_manager.cc:2213] created HMS catalog entry for table [id=007f259f669b415b84b034a0f18005d2]
I20260928 07:56:27.817721 29133 catalog_manager.cc:5063] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): tablet 3e15ae22ba5d46c09b1cc9d99dce8b38 (table default.table_cf58487e79464a79a31128dfc7c26d09 [id=88d7ad10b80e4de1ac51b0f3506b8072]) successfully deleted
W20260928 07:56:27.817971 27828 catalog_manager.cc:2241] Illegal state: an error occurred while writing to the sys-catalog: replica dfb6604d9ebb423090c878c2b1db0cab is not leader of this config: current role FOLLOWER
I20260928 07:56:27.822507 29640 raft_consensus.cc:2749] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:27.822621 28142 leader_election.cc:304] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
@ 0x7f98fac43920 google::LogMessage::Flush() at ??:0
I20260928 07:56:27.824805 29623 raft_consensus.cc:2804] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 07:56:27.825343 29623 raft_consensus.cc:493] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 07:56:27.825707 29623 raft_consensus.cc:3060] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.834041 29443 leader_election.cc:290] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Requested vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:27.835219 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab26a3171e454498852530ac879e6c" candidate_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
W20260928 07:56:27.836690 28285 leader_election.cc:343] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497): Illegal state: must be running to vote when last-logged opid is not known
@ 0x7f98fac4368f google::LogMessage::~LogMessage() at ??:0
I20260928 07:56:27.843712 29623 raft_consensus.cc:515] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.841290 28207 raft_consensus.cc:2468] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in term 1.
I20260928 07:56:27.846308 28286 leader_election.cc:304] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters: bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:27.847378 29443 raft_consensus.cc:2804] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:27.809054 29621 raft_consensus.cc:385] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:27.847998 29621 raft_consensus.cc:740] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:27.850445 29443 raft_consensus.cc:697] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd67de620c94af3b7c8e3ba7d42f980, State: Running, Role: LEADER
I20260928 07:56:27.851303 29443 consensus_queue.cc:237] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.853181 29621 consensus_queue.cc:260] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.854321 28494 raft_consensus.cc:2468] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 0.
I20260928 07:56:27.861896 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2d09a0cf79421dbc71a32fb55b1e25" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980"
I20260928 07:56:27.862486 28347 raft_consensus.cc:3060] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.873379 28494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2d09a0cf79421dbc71a32fb55b1e25" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e"
I20260928 07:56:27.873994 28494 raft_consensus.cc:3060] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
I20260928 07:56:27.876031 28347 raft_consensus.cc:2468] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
I20260928 07:56:27.877179 28142 leader_election.cc:304] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5; no voters:
I20260928 07:56:27.878064 29209 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]). Expected version 1 got 0
I20260928 07:56:27.856065 29621 ts_tablet_manager.cc:1434] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.050s user 0.004s sys 0.002s
I20260928 07:56:27.883713 29623 leader_election.cc:290] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 election: Requested vote from peers bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:27.884279 29623 raft_consensus.cc:2804] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 07:56:27.887404 29621 tablet_bootstrap.cc:492] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e: Bootstrap starting.
I20260928 07:56:27.888353 29623 raft_consensus.cc:697] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 LEADER]: Becoming Leader. State: Replica: acdaa3cf2ffd45f5b55a169c1bacead5, State: Running, Role: LEADER
I20260928 07:56:27.889155 29623 consensus_queue.cc:237] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:27.906458 28494 raft_consensus.cc:2468] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acdaa3cf2ffd45f5b55a169c1bacead5 in term 1.
W20260928 07:56:27.930615 28142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.194:42035, user_credentials={real_user=slave}} blocked reactor thread for 53517.9us
I20260928 07:56:27.931814 29216 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]). Expected version 1 got 0
I20260928 07:56:27.936713 29209 catalog_manager.cc:5838] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194). New cstate: current_term: 1 leader_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: HEALTHY } } }
I20260928 07:56:27.938772 29621 tablet_bootstrap.cc:654] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e: Neither blocks nor log segments found. Creating new log.
I20260928 07:56:27.985659 29216 catalog_manager.cc:5838] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 reported cstate change: term changed from 0 to 1, leader changed from <none> to acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193). New cstate: current_term: 1 leader_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } health_report { overall_health: UNKNOWN } } }
I20260928 07:56:27.986999 29216 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]). Expected version 1 got 0
I20260928 07:56:28.007025 29621 tablet_bootstrap.cc:492] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e: No bootstrap required, opened a new log
I20260928 07:56:28.007547 29621 ts_tablet_manager.cc:1403] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e: Time spent bootstrapping tablet: real 0.124s user 0.007s sys 0.003s
I20260928 07:56:28.011061 29621 raft_consensus.cc:359] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:28.011847 29621 raft_consensus.cc:385] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 07:56:28.012163 29621 raft_consensus.cc:740] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae11841a62f429a98a978de5b7bd60e, State: Initialized, Role: FOLLOWER
I20260928 07:56:28.012946 29621 consensus_queue.cc:260] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:28.015528 29621 ts_tablet_manager.cc:1434] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260928 07:56:28.033176 29623 raft_consensus.cc:493] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:28.033661 29623 raft_consensus.cc:515] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } } peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } }
I20260928 07:56:28.035554 29623 leader_election.cc:290] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035), bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497)
I20260928 07:56:28.037454 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e321ad85a4e488cb28c4b63be927342" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:28.039363 28497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e321ad85a4e488cb28c4b63be927342" candidate_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bae11841a62f429a98a978de5b7bd60e" is_pre_election: true
I20260928 07:56:28.040096 28497 raft_consensus.cc:2393] T 3e321ad85a4e488cb28c4b63be927342 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate acdaa3cf2ffd45f5b55a169c1bacead5 in current term 1: Already voted for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in this term.
I20260928 07:56:28.041572 28141 leader_election.cc:304] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acdaa3cf2ffd45f5b55a169c1bacead5; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, bae11841a62f429a98a978de5b7bd60e
I20260928 07:56:28.042995 29623 raft_consensus.cc:3060] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 0 FOLLOWER]: Advancing to term 1
@ 0x7f9905dd635c kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260928 07:56:28.049736 29623 raft_consensus.cc:2749] T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:28.109344 27827 catalog_manager.cc:2223] deleted orphaned HMS catalog entry for table [id=d4c1748ce57c4d42b5bcc0de6bf1177c]
I20260928 07:56:28.110328 27827 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 150) took 7021 ms. Trace:
I20260928 07:56:28.110644 27827 rpcz_store.cc:276] 0928 07:56:21.089384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:21.460173 (+370789us) service_pool.cc:224] Handling call
0928 07:56:25.198802 (+3738629us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:25.225949 (+ 27147us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:27.704849 (+2478900us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:27.706787 (+ 1938us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:27.706808 (+ 21us) write_op.cc:454] Released schema lock
0928 07:56:27.707374 (+ 566us) catalog_manager.cc:2220] Rolling back HMS table creation
0928 07:56:28.110258 (+402884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:27.706574 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica dfb6604d9ebb423090c878c2b1db0cab is not leader of this config: current role FOLLOWER)
0928 07:56:27.706613 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:27.706636 (+ 23us) write_op.cc:454] Released schema lock
0928 07:56:27.706658 (+ 22us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":2121627,"Hive Metastore.run_cpu_time_us":1064,"Hive Metastore.run_wall_time_us":757240,"child_traces":[["op",{}]]}
W20260928 07:56:28.115865 28556 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.221.252:41205)
@ 0x7f9905dd5b1c kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260928 07:56:28.137115 29216 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38488:
name: "default.Table_e54258c46322425fad34e060fa60546a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:28.136039 29623 consensus_queue.cc:1048] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
@ 0x7f9905dd9b92 kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260928 07:56:28.199241 29209 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
@ 0x7f9905dd9b4a _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
I20260928 07:56:28.220170 29209 catalog_manager.cc:5938] TS acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
I20260928 07:56:28.222354 29644 consensus_queue.cc:1048] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:28.240015 29443 consensus_queue.cc:1048] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
@ 0x7f9905dd9ada std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
I20260928 07:56:28.266229 29443 consensus_queue.cc:1048] T 3e321ad85a4e488cb28c4b63be927342 P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
@ 0x7f9905dd9aa2 std::__1::__function::__alloc_func<>::operator()() at ??:0
I20260928 07:56:28.291407 29640 raft_consensus.cc:493] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 07:56:28.292028 29640 raft_consensus.cc:515] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 } } peers { permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 } } peers { permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 } }
I20260928 07:56:28.297917 29640 leader_election.cc:290] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acdaa3cf2ffd45f5b55a169c1bacead5 (127.26.221.193:33039), 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035)
I20260928 07:56:28.297832 28206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab26a3171e454498852530ac879e6c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" is_pre_election: true
I20260928 07:56:28.298704 28206 raft_consensus.cc:2393] T 21ab26a3171e454498852530ac879e6c P acdaa3cf2ffd45f5b55a169c1bacead5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bae11841a62f429a98a978de5b7bd60e in current term 1: Already voted for candidate 3bd67de620c94af3b7c8e3ba7d42f980 in this term.
I20260928 07:56:28.299672 28347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab26a3171e454498852530ac879e6c" candidate_uuid: "bae11841a62f429a98a978de5b7bd60e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" is_pre_election: true
I20260928 07:56:28.301390 28434 leader_election.cc:304] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bae11841a62f429a98a978de5b7bd60e; no voters: 3bd67de620c94af3b7c8e3ba7d42f980, acdaa3cf2ffd45f5b55a169c1bacead5
I20260928 07:56:28.302858 29640 raft_consensus.cc:3060] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [term 0 FOLLOWER]: Advancing to term 1
@ 0x7f9905dd8d9e std::__1::__function::__func<>::operator()() at ??:0
@ 0x5bd4e5 std::__1::__function::__value_func<>::operator()() at ??:?
@ 0x5bd31a std::__1::function<>::operator()() at ??:?
I20260928 07:56:28.326691 29623 consensus_queue.cc:1048] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:28.331947 27828 catalog_manager.cc:2223] deleted orphaned HMS catalog entry for table [id=007f259f669b415b84b034a0f18005d2]
I20260928 07:56:28.332919 27828 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51542 (request call id 151) took 6994 ms. Trace:
I20260928 07:56:28.333897 27828 rpcz_store.cc:276] 0928 07:56:21.338547 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:21.544080 (+205533us) service_pool.cc:224] Handling call
0928 07:56:25.202698 (+3658618us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 07:56:25.227931 (+ 25233us) catalog_manager.cc:2186] Created new table and tablet info
0928 07:56:27.815896 (+2587965us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 07:56:27.817721 (+ 1825us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:27.817742 (+ 21us) write_op.cc:454] Released schema lock
0928 07:56:27.818272 (+ 530us) catalog_manager.cc:2220] Rolling back HMS table creation
0928 07:56:28.332818 (+514546us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 07:56:27.817515 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica dfb6604d9ebb423090c878c2b1db0cab is not leader of this config: current role FOLLOWER)
0928 07:56:27.817551 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0928 07:56:27.817572 (+ 21us) write_op.cc:454] Released schema lock
0928 07:56:27.817592 (+ 20us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":2766300,"Hive Metastore.run_cpu_time_us":1135,"Hive Metastore.run_wall_time_us":333990,"child_traces":[["op",{}]]}
I20260928 07:56:28.344525 29209 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38488:
name: "default.Table_e67f035c8fbf43c4ab59b6f0c127d5a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 07:56:28.422955 29659 log.cc:927] Time spent T 3e321ad85a4e488cb28c4b63be927342 P acdaa3cf2ffd45f5b55a169c1bacead5: Append to log took a long time: real 0.098s user 0.001s sys 0.000s
I20260928 07:56:28.439527 29212 catalog_manager.cc:5938] TS 3bd67de620c94af3b7c8e3ba7d42f980 (127.26.221.194:42035) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
W20260928 07:56:28.457720 29660 log.cc:927] Time spent T fa4546b980894e68bb371bdda05058b6 P 3bd67de620c94af3b7c8e3ba7d42f980: Append to log took a long time: real 0.056s user 0.000s sys 0.001s
I20260928 07:56:28.486603 28347 raft_consensus.cc:1275] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980 [term 1 FOLLOWER]: Refusing update from remote peer acdaa3cf2ffd45f5b55a169c1bacead5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:28.498267 29623 consensus_queue.cc:1048] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bd67de620c94af3b7c8e3ba7d42f980" member_type: VOTER last_known_addr { host: "127.26.221.194" port: 42035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x7f98fce3981b kudu::Thread::SuperviseThread() at ??:0
@ 0x4569a0 __tsan_thread_start_func at ??:?
@ 0x7f98fe59a6db start_thread at ??:0
I20260928 07:56:28.569840 29212 catalog_manager.cc:5938] TS bae11841a62f429a98a978de5b7bd60e (127.26.221.195:44497) does not have the latest schema for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]). Expected version 1 got 0
W20260928 07:56:28.574299 27815 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2aac87ee995c415f8c4151ca1b926b10 consensus state has no leader
@ 0x7f98f98e561f clone at ??:0
I20260928 07:56:28.619984 29640 raft_consensus.cc:2749] T 21ab26a3171e454498852530ac879e6c P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 07:56:28.640657 28497 raft_consensus.cc:1275] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e [term 1 FOLLOWER]: Refusing update from remote peer acdaa3cf2ffd45f5b55a169c1bacead5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 07:56:28.654384 29670 tablet.cc:1751] T d4fa2c780a744b30be854f00223cb472 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:28.671411 29671 tablet.cc:1751] T d4fa2c780a744b30be854f00223cb472 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:28.704595 29644 consensus_queue.cc:1048] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:28.744650 29674 tablet.cc:1751] T 7d2d09a0cf79421dbc71a32fb55b1e25 P acdaa3cf2ffd45f5b55a169c1bacead5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:28.761782 29675 tablet.cc:1751] T 7d2d09a0cf79421dbc71a32fb55b1e25 P 3bd67de620c94af3b7c8e3ba7d42f980: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:28.812642 29623 consensus_queue.cc:1048] T fa4546b980894e68bb371bdda05058b6 P acdaa3cf2ffd45f5b55a169c1bacead5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:28.856923 29677 tablet.cc:1751] T d4fa2c780a744b30be854f00223cb472 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:28.937036 29663 consensus_queue.cc:1048] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae11841a62f429a98a978de5b7bd60e" member_type: VOTER last_known_addr { host: "127.26.221.195" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 07:56:29.026013 29683 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b64b51f6f084474eb360161ac99f9b16)
I20260928 07:56:29.026556 29683 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:29.034013 29443 consensus_queue.cc:1048] T 21ab26a3171e454498852530ac879e6c P 3bd67de620c94af3b7c8e3ba7d42f980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acdaa3cf2ffd45f5b55a169c1bacead5" member_type: VOTER last_known_addr { host: "127.26.221.193" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 07:56:29.056173 29677 tablet.cc:1751] T 7d2d09a0cf79421dbc71a32fb55b1e25 P bae11841a62f429a98a978de5b7bd60e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 07:56:29.070107 29681 raft_consensus.cc:493] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b64b51f6f084474eb360161ac99f9b16)
I20260928 07:56:29.070642 29681 raft_consensus.cc:515] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:29.073832 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 8 candidate_status { last_received { term: 7 index: 292 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" is_pre_election: true
I20260928 07:56:29.074538 27914 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dfb6604d9ebb423090c878c2b1db0cab in term 7.
I20260928 07:56:29.075928 27813 leader_election.cc:304] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0; no voters:
I20260928 07:56:29.091774 29683 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:29.097265 29681 leader_election.cc:290] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
I20260928 07:56:29.098008 29681 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260928 07:56:29.098409 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 8 candidate_status { last_received { term: 7 index: 292 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:29.098352 29681 raft_consensus.cc:493] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Starting leader election (detected failure of leader b64b51f6f084474eb360161ac99f9b16)
I20260928 07:56:29.100379 29681 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 7 FOLLOWER]: Advancing to term 8
I20260928 07:56:29.117691 29681 raft_consensus.cc:515] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:29.119138 27838 raft_consensus.cc:2393] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f95afb2252e047ff9f5427a1cd7c0df0 in current term 8: Already voted for candidate dfb6604d9ebb423090c878c2b1db0cab in this term.
I20260928 07:56:29.122172 29681 leader_election.cc:290] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 8 election: Requested vote from peers f95afb2252e047ff9f5427a1cd7c0df0 (127.26.221.253:45305), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:29.171408 27813 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.253:45305, user_credentials={real_user=slave}} blocked reactor thread for 95551.2us
I20260928 07:56:29.174885 27914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfb6604d9ebb423090c878c2b1db0cab" candidate_term: 8 candidate_status { last_received { term: 7 index: 292 } } ignore_live_leader: false dest_uuid: "f95afb2252e047ff9f5427a1cd7c0df0"
I20260928 07:56:29.175462 27914 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 7 FOLLOWER]: Advancing to term 8
I20260928 07:56:29.192553 27914 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dfb6604d9ebb423090c878c2b1db0cab in term 8.
I20260928 07:56:29.193874 27813 leader_election.cc:304] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfb6604d9ebb423090c878c2b1db0cab, f95afb2252e047ff9f5427a1cd7c0df0; no voters:
I20260928 07:56:29.194682 29688 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 8 FOLLOWER]: Leader election won for term 8
I20260928 07:56:29.195151 29688 raft_consensus.cc:697] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [term 8 LEADER]: Becoming Leader. State: Replica: dfb6604d9ebb423090c878c2b1db0cab, State: Running, Role: LEADER
I20260928 07:56:29.195909 29688 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 292, Committed index: 292, Last appended: 7.292, Last appended by leader: 292, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:29.200001 29681 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 8 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:29.200738 29681 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:56:29.218995 29693 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
W20260928 07:56:29.345177 28143 connection.cc:573] server connection from 127.0.0.1:50024 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 07:56:29.348970 27816 connection.cc:573] client connection to 127.26.221.252:41205 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 07:56:29.349447 27816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
W20260928 07:56:29.355145 27891 connection.cc:573] client connection to 127.26.221.252:41205 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 07:56:29.355611 27891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 07:56:29.364611 28143 connection.cc:573] client connection to 127.26.221.252:41205 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 07:56:29.365702 28435 connection.cc:573] client connection to 127.26.221.252:41205 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 07:56:29.374625 28287 connection.cc:573] client connection to 127.26.221.252:41205 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 07:56:29.376338 28557 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.221.252:41205)
W20260928 07:56:29.432706 27891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.221.252:41205, user_credentials={real_user=slave}} blocked reactor thread for 77099.1us
W20260928 07:56:29.439762 29697 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 07:56:29.367034 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.26.221.252:41205 (local address 127.26.221.193:39085)
0928 07:56:29.438339 (+ 71305us) negotiation.cc:107] Waiting for socket to connect
0928 07:56:29.438616 (+ 277us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":70413,"threads_started":1}
W20260928 07:56:29.444070 29696 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 07:56:29.359490 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.26.221.252:41205 (local address 127.0.0.1:44596)
0928 07:56:29.442776 (+ 83286us) negotiation.cc:107] Waiting for socket to connect
0928 07:56:29.443059 (+ 283us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":82295,"threads_started":1}
W20260928 07:56:29.454259 29700 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 07:56:29.379043 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.26.221.252:41205 (local address 127.26.221.194:40383)
0928 07:56:29.417854 (+ 38811us) negotiation.cc:107] Waiting for socket to connect
0928 07:56:29.418418 (+ 564us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":37106,"threads_started":1}
W20260928 07:56:29.458557 29698 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 07:56:29.368759 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.26.221.252:41205 (local address 127.26.221.195:47267)
0928 07:56:29.457371 (+ 88612us) negotiation.cc:107] Waiting for socket to connect
0928 07:56:29.457647 (+ 276us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":87865,"thread_start_us":87243,"threads_started":1}
W20260928 07:56:29.460322 27816 leader_election.cc:336] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection reset by peer (error 104)
W20260928 07:56:29.461146 27816 leader_election.cc:336] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection reset by peer (error 104)
W20260928 07:56:29.461935 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:56:29.462411 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:29.463153 29683 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260928 07:56:29.464900 29699 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 07:56:29.377888 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.26.221.252:41205 (local address 127.0.0.1:44612)
0928 07:56:29.456782 (+ 78894us) negotiation.cc:107] Waiting for socket to connect
0928 07:56:29.458681 (+ 1899us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":67246,"thread_start_us":66923,"threads_started":1}
W20260928 07:56:29.659441 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 07:56:29.804291 27914 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Refusing update from remote peer dfb6604d9ebb423090c878c2b1db0cab: Log matching property violated. Preceding OpId in replica: term: 7 index: 292. Preceding OpId from leader: term: 8 index: 293. (index mismatch)
I20260928 07:56:29.809211 29681 consensus_queue.cc:1048] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 293, Last known committed idx: 292, Time since last communication: 0.001s
I20260928 07:56:29.834146 29683 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb6604d9ebb423090c878c2b1db0cab. Latest consensus state: current_term: 8 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:29.835134 29683 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:56:29.870308 29683 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:29.871080 29683 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 07:56:29.877312 29681 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "dfb6604d9ebb423090c878c2b1db0cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } } }
I20260928 07:56:29.878018 29681 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab [sys.catalog]: This master's current role is: LEADER
I20260928 07:56:30.815095 29718 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:30.815771 29718 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:30.827164 29718 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:30.862417 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:31.292863 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet dda49b3ac3104f47bbfc2c780282abca (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet dda49b3ac3104f47bbfc2c780282abca consensus state has no leader
W20260928 07:56:32.165614 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Timed out: RequestConsensusVote RPC to 127.26.221.254:36357 timed out after 0.663s (SENT)
I20260928 07:56:32.166119 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:32.167768 29735 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:56:32.204180 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260928 07:56:32.836561 29743 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:32.837087 29743 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:32.838972 29743 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:32.848333 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:33.902586 27813 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d1adb4f2f0dc4a86a2fffabf41436e4f (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d1adb4f2f0dc4a86a2fffabf41436e4f consensus state has no leader
W20260928 07:56:33.924639 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Timed out: RequestConsensusVote RPC to 127.26.221.254:36357 timed out after 0.531s (SENT)
I20260928 07:56:33.925328 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:33.926882 29756 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:56:34.656746 27816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20260928 07:56:34.660959 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260928 07:56:35.876277 27814 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f21e8b5dc66f42109f6484aa6908c9be (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f21e8b5dc66f42109f6484aa6908c9be consensus state has no leader
I20260928 07:56:37.041286 29788 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:37.041946 29788 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:37.044178 29788 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:37.047463 27891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260928 07:56:37.051590 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:37.081678 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260928 07:56:37.275038 28393 debug-util.cc:398] Leaking SignalData structure 0x7b080012d380 after lost signal to thread 28265
W20260928 07:56:37.276356 28393 debug-util.cc:398] Leaking SignalData structure 0x7b0800132140 after lost signal to thread 28396
W20260928 07:56:38.447069 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Timed out: RequestConsensusVote RPC to 127.26.221.254:36357 timed out after 0.695s (SENT)
I20260928 07:56:38.447558 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:38.456441 29810 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:56:38.922379 27816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.252:41205, user_credentials={real_user=slave}} blocked reactor thread for 59999us
W20260928 07:56:39.922379 27816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260928 07:56:39.925370 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260928 07:56:40.172717 29829 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:40.173240 29829 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:40.175426 29829 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:40.192725 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:41.214139 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Timed out: RequestConsensusVote RPC to 127.26.221.254:36357 timed out after 0.516s (SENT)
I20260928 07:56:41.214668 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:41.219370 29845 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:56:42.297048 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260928 07:56:43.179534 29866 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:43.180214 29866 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:43.186273 29866 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:43.211453 27891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 07:56:43.244863 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:44.424701 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Timed out: RequestConsensusVote RPC to 127.26.221.254:36357 timed out after 0.619s (SENT)
I20260928 07:56:44.425139 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:44.444205 29885 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:56:45.009552 27815 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2aac87ee995c415f8c4151ca1b926b10 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2aac87ee995c415f8c4151ca1b926b10 consensus state has no leader
W20260928 07:56:45.051431 27816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260928 07:56:45.061201 27816 consensus_peers.cc:597] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab -> Peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Couldn't send request to peer b64b51f6f084474eb360161ac99f9b16. Status: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260928 07:56:45.194128 29895 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:45.194818 29895 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:45.203064 29895 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:45.233414 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:56:46.315358 29693 catalog_manager.cc:692] Loaded metadata for table default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18]
I20260928 07:56:46.317188 29693 catalog_manager.cc:692] Loaded metadata for table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264]
I20260928 07:56:46.318727 29693 catalog_manager.cc:692] Loaded metadata for table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4]
I20260928 07:56:46.320236 29693 catalog_manager.cc:692] Loaded metadata for table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033]
I20260928 07:56:46.322479 29693 catalog_manager.cc:692] Loaded metadata for table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed]
I20260928 07:56:46.330690 29693 catalog_manager.cc:692] Loaded metadata for table default.table_1f78a84fc89e458e8b34bcaa23bdc72d [id=209eb88d159b41809555701a991da647]
I20260928 07:56:46.333458 29693 catalog_manager.cc:692] Loaded metadata for table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625]
I20260928 07:56:46.347470 29693 catalog_manager.cc:692] Loaded metadata for table default.table_34c72cbfe84d4e0397aee47a3f75b67a [id=314da4c670c14fba843c4688089189c5]
I20260928 07:56:46.349165 29693 catalog_manager.cc:692] Loaded metadata for table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2]
I20260928 07:56:46.350869 29693 catalog_manager.cc:692] Loaded metadata for table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3]
I20260928 07:56:46.356789 29693 catalog_manager.cc:692] Loaded metadata for table default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02]
I20260928 07:56:46.361030 29693 catalog_manager.cc:692] Loaded metadata for table default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9]
I20260928 07:56:46.373394 29693 catalog_manager.cc:692] Loaded metadata for table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7]
I20260928 07:56:46.384191 29693 catalog_manager.cc:692] Loaded metadata for table default.table_2519a070e9974faeb26f6bcd4756d344 [id=5ede51d78549417b8bfc039f2d7c87f6]
I20260928 07:56:46.386675 29693 catalog_manager.cc:692] Loaded metadata for table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5]
I20260928 07:56:46.394799 29693 catalog_manager.cc:692] Loaded metadata for table default.table_da656d08cd28419b8599a14b3946a15a [id=7d3bf1f44d9443b78713cb43948ae519]
I20260928 07:56:46.402729 29693 catalog_manager.cc:692] Loaded metadata for table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9]
I20260928 07:56:46.405791 29693 catalog_manager.cc:692] Loaded metadata for table default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765]
I20260928 07:56:46.410867 29693 catalog_manager.cc:692] Loaded metadata for table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6]
I20260928 07:56:46.413990 29693 catalog_manager.cc:692] Loaded metadata for table default.table_cc618d40e945497e85e73c63ae4b6bd5 [id=bf58ecfe97d24b4792838142aae14f6c]
I20260928 07:56:46.447170 29693 catalog_manager.cc:692] Loaded metadata for table default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55]
I20260928 07:56:46.457818 29693 catalog_manager.cc:692] Loaded metadata for table default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595]
I20260928 07:56:46.459671 29693 catalog_manager.cc:692] Loaded metadata for table default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc]
I20260928 07:56:46.471452 29693 catalog_manager.cc:692] Loaded metadata for table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9]
W20260928 07:56:46.497058 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Timed out: RequestConsensusVote RPC to 127.26.221.254:36357 timed out after 0.646s (SENT)
I20260928 07:56:46.497766 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:46.516703 29917 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:56:46.566527 29693 tablet_loader.cc:96] loaded metadata for tablet 21ab26a3171e454498852530ac879e6c (table default.table_34c72cbfe84d4e0397aee47a3f75b67a [id=314da4c670c14fba843c4688089189c5])
I20260928 07:56:46.570919 29693 tablet_loader.cc:96] loaded metadata for tablet 2de0f3ba82a4442588cbb547f3cf9881 (table default.table_39d378a820034bbbbd5505707a436c63 [id=c10445efe1fa43b2a9e79b12c9a6da55])
I20260928 07:56:46.573861 29693 tablet_loader.cc:96] loaded metadata for tablet 34a0cf784aee4d0e9b7b269182ba7de3 (table default.table_b86c301602f645dda93f94e00e31e9fb [id=d339f7eb2ccd40fa88e0ba9a4dff6595])
I20260928 07:56:46.577610 29693 tablet_loader.cc:96] loaded metadata for tablet 3e321ad85a4e488cb28c4b63be927342 (table default.table_cc618d40e945497e85e73c63ae4b6bd5 [id=bf58ecfe97d24b4792838142aae14f6c])
I20260928 07:56:46.579766 29693 tablet_loader.cc:96] loaded metadata for tablet 3e70055265684586972191331e0dd5cd (table default.table_f203729d2d3041b290a7ab286fa28365 [id=388cd42a4adf4001ba834ceb219df8b7])
I20260928 07:56:46.581867 29693 tablet_loader.cc:96] loaded metadata for tablet 41352cf9a4974e2b861d2234d9a5accd (table default.table_569bbac4a1954d0bb6993bcd887049cd [id=dc06a80441584734993d844845f8bdcc])
I20260928 07:56:46.583098 29693 tablet_loader.cc:96] loaded metadata for tablet 42897682db564e56b8e6bf8b75f8641c (table default.table_d8257603a177421fb0fbc39534fb7e0f [id=37cb2283a0b64189b50487bda9b788a9])
I20260928 07:56:46.585081 29693 tablet_loader.cc:96] loaded metadata for tablet 48ed97fd35ee42f3957a18f48fac07bb (table default.table_579ed77832b347ea98ea15d75bc5775d [id=8050a64da16d4203b539e643bf5c92a9])
I20260928 07:56:46.591374 29693 tablet_loader.cc:96] loaded metadata for tablet 5c670de5690141bea18b9a07d1e950d4 (table default.table_308d75eb3d2d411cbdf3c7891303e356 [id=32c6fc06bd3943feafb83880480a76c2])
I20260928 07:56:46.593432 29693 tablet_loader.cc:96] loaded metadata for tablet 62bc065c9f2743c9ae79dc37bc6de0c2 (table default.table_65e854322c2740fcb3feff80ea836959 [id=9786bf823c44447594c640824e210bc6])
I20260928 07:56:46.602321 29693 tablet_loader.cc:96] loaded metadata for tablet 711949ab6f4548d09e06b849202d2d90 (table default.table_08d1c01076584e7b991014697596a21e [id=34b3a93d8c664dd781fd1315e4a838f3])
I20260928 07:56:46.603814 29693 tablet_loader.cc:96] loaded metadata for tablet 7d2d09a0cf79421dbc71a32fb55b1e25 (table default.table_4406084e67ac4a3a86bbb72e9c6d569a [id=f5cc5d847243471fb78c00c7ff2bdbe9])
I20260928 07:56:46.610869 29693 tablet_loader.cc:96] loaded metadata for tablet 7ec9ebafa7c248ceb280587e49d964b7 (table default.table_445618083a03421da2ce363c50d436ac [id=70e3f9e8536c49d3b69119f2f2968ba5])
I20260928 07:56:46.643409 29693 tablet_loader.cc:96] loaded metadata for tablet 8a991fd5fd32408ba8e1065a855b06d3 (table default.table_1f78a84fc89e458e8b34bcaa23bdc72d [id=209eb88d159b41809555701a991da647])
I20260928 07:56:46.651773 29693 tablet_loader.cc:96] loaded metadata for tablet 8fe80328a63344f78528b8537b3dbf0c (table default.table_24b63d04506b49d6b8b529558de57186 [id=0edebaf949644c84a64c95e5cfae4bf4])
I20260928 07:56:46.658674 29693 tablet_loader.cc:96] loaded metadata for tablet 9e5a4815e0004b5e827e30ccbe9073f1 (table default.table_2a0111dbc5c34f6e9adeaff86b2c2769 [id=0485a22c767b4bcf9cf4424064408d18])
I20260928 07:56:46.660471 29693 tablet_loader.cc:96] loaded metadata for tablet 9eaff4ec62804f00a750d1d31f44366d (table default.table_da656d08cd28419b8599a14b3946a15a [id=7d3bf1f44d9443b78713cb43948ae519])
I20260928 07:56:46.661669 29693 tablet_loader.cc:96] loaded metadata for tablet a018e7ed93784490a5510bafd25348df (table default.table_8b06fb4bc5314df789c0bf92a96b2811 [id=16bd6197a0014263bed84d67e86249a4])
I20260928 07:56:46.664287 29693 tablet_loader.cc:96] loaded metadata for tablet ac6814b6cc3642bf8cb48fe7dced6833 (table default.table_90fcf6263808404eba291d0ffe2cc50e [id=1fe89d7dbd8f4ac092797bdc68966aed])
I20260928 07:56:46.667912 29693 tablet_loader.cc:96] loaded metadata for tablet b801232a1a4f4b0a80974fc838a3b6f5 (table default.table_2f6a2670bc2641a2b325d75d83c5db8e [id=1367a86afa4a49bab81bb716c0bdf033])
I20260928 07:56:46.671566 29693 tablet_loader.cc:96] loaded metadata for tablet bbeec0005d4144a2a3b888b7dbcb5087 (table default.table_2519a070e9974faeb26f6bcd4756d344 [id=5ede51d78549417b8bfc039f2d7c87f6])
I20260928 07:56:46.687031 29693 tablet_loader.cc:96] loaded metadata for tablet d139c0b8379446dfba037e96e0501a0b (table default.table_a5ebdbbec89645fe963b774cb3b57dae [id=36f9b53b9add43e598bd6cd38e694c02])
I20260928 07:56:46.694037 29693 tablet_loader.cc:96] loaded metadata for tablet d4fa2c780a744b30be854f00223cb472 (table default.table_dc4f70aae79849ffaa203b8cc751126e [id=069e22d7ef5d43e1b5e323608df44264])
I20260928 07:56:46.698014 29693 tablet_loader.cc:96] loaded metadata for tablet d9cf8015fec54fb7874e93717fc8d38b (table default.table_cf5b0809ce954e06aacdc06963219c0c [id=2d81b3a1fd594d3687165ee0512c4625])
I20260928 07:56:46.708932 29693 tablet_loader.cc:96] loaded metadata for tablet fa4546b980894e68bb371bdda05058b6 (table default.table_dacc6ff6b7fa48c78a6b028734185c0a [id=8e3317b33e604a2b85b826a836bb8765])
W20260928 07:56:46.718659 29693 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Loading table and tablet metadata into memory: real 17.499s user 0.159s sys 0.052s
I20260928 07:56:46.719179 29693 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 07:56:46.718850 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:46.719503 27831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
W20260928 07:56:46.720170 27832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 29) took 6024 ms (client timeout 516 ms). Trace:
W20260928 07:56:46.720491 27831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 30) took 3534 ms (client timeout 619 ms). Trace:
W20260928 07:56:46.720845 27831 rpcz_store.cc:269] 0928 07:56:43.185651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:43.186923 (+ 1272us) service_pool.cc:224] Handling call
0928 07:56:46.720401 (+3533478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:46.722146 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:46.722093 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
W20260928 07:56:46.723032 27839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 23) took 15221 ms (client timeout 663 ms). Trace:
W20260928 07:56:46.723074 27836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 25) took 13330 ms (client timeout 531 ms). Trace:
W20260928 07:56:46.723346 27839 rpcz_store.cc:269] 0928 07:56:31.501583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:31.501756 (+ 173us) service_pool.cc:224] Handling call
0928 07:56:46.722931 (+15221175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 07:56:46.723387 27836 rpcz_store.cc:269] 0928 07:56:33.392893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:33.393118 (+ 225us) service_pool.cc:224] Handling call
0928 07:56:46.723001 (+13329883us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 07:56:46.724568 27836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 32) took 1527 ms (client timeout 646 ms). Trace:
W20260928 07:56:46.725317 27836 rpcz_store.cc:269] 0928 07:56:45.197565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:46.724369 (+1526804us) service_pool.cc:211] Skipping call since client already timed out
0928 07:56:46.724494 (+ 125us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 07:56:46.726331 27831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 33) took 874 ms (client timeout 646 ms). Trace:
W20260928 07:56:46.726693 27831 rpcz_store.cc:269] 0928 07:56:45.851685 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:46.725889 (+874204us) service_pool.cc:211] Skipping call since client already timed out
0928 07:56:46.726273 (+ 384us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 07:56:46.726935 27828 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:51542 (request call id 159) took 17349 ms. Trace:
I20260928 07:56:46.728482 27828 rpcz_store.cc:276] 0928 07:56:29.377681 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:29.377841 (+ 160us) service_pool.cc:224] Handling call
0928 07:56:46.726713 (+17348872us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:46.725380 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:46.724728 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:46.730858 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
W20260928 07:56:46.720593 27832 rpcz_store.cc:269] 0928 07:56:40.696228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:40.696460 (+ 232us) service_pool.cc:224] Handling call
0928 07:56:46.720044 (+6023584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:46.731089 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:46.730903 27830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
I20260928 07:56:46.732455 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" candidate_term: 9 candidate_status { last_received { term: 8 index: 293 } } ignore_live_leader: false dest_uuid: "dfb6604d9ebb423090c878c2b1db0cab" is_pre_election: true
W20260928 07:56:46.733049 27837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 24) took 13893 ms (client timeout 531 ms). Trace:
W20260928 07:56:46.734409 27837 rpcz_store.cc:269] 0928 07:56:32.839462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:32.839672 (+ 210us) service_pool.cc:224] Handling call
0928 07:56:46.732957 (+13893285us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 07:56:46.735616 27835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 26) took 9689 ms (client timeout 695 ms). Trace:
W20260928 07:56:46.735972 27835 rpcz_store.cc:269] 0928 07:56:37.045778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:37.046024 (+ 246us) service_pool.cc:224] Handling call
0928 07:56:46.735478 (+9689454us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 07:56:46.739534 27838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 22) took 15921 ms (client timeout 663 ms). Trace:
W20260928 07:56:46.732146 27833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 28) took 6556 ms (client timeout 516 ms). Trace:
W20260928 07:56:46.741537 27834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 27) took 8990 ms (client timeout 695 ms). Trace:
W20260928 07:56:46.739876 27838 rpcz_store.cc:269] 0928 07:56:30.818667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:30.818825 (+ 158us) service_pool.cc:224] Handling call
0928 07:56:46.739456 (+15920631us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 07:56:46.742275 27834 rpcz_store.cc:269] 0928 07:56:37.751543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:37.751800 (+ 257us) service_pool.cc:224] Handling call
0928 07:56:46.741203 (+8989403us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 07:56:46.742195 27833 rpcz_store.cc:269] 0928 07:56:40.175861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:40.176497 (+ 636us) service_pool.cc:224] Handling call
0928 07:56:46.732054 (+6555557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:46.745267 29693 catalog_manager.cc:1308] Loaded cluster ID: 9ec5f5a0ebfb4a28993124d3fd7060b5
I20260928 07:56:46.745548 29693 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
W20260928 07:56:46.746460 27830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59074 (request call id 31) took 2940 ms (client timeout 619 ms). Trace:
W20260928 07:56:46.748394 27830 rpcz_store.cc:269] 0928 07:56:43.805953 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 07:56:43.806220 (+ 267us) service_pool.cc:224] Handling call
0928 07:56:46.746392 (+2940172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 07:56:46.760574 29693 catalog_manager.cc:1553] Loading token signing keys...
I20260928 07:56:46.778599 29693 catalog_manager.cc:6230] T 00000000000000000000000000000000 P dfb6604d9ebb423090c878c2b1db0cab: Loaded TSK: 0
I20260928 07:56:46.779628 29693 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 07:56:46.788769 29693 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 07:56:46.797132 29693 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 51
I20260928 07:56:46.805584 27828 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_e67f035c8fbf43c4ab59b6f0c127d5a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 07:56:46.806047 27827 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51542:
name: "default.Table_e54258c46322425fad34e060fa60546a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260928 07:56:46.813663 28092 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 52, previous 52; dumping first 2 out of 6 received events: NotificationEvent(eventId=52, eventTime=1790582187, eventType=DROP_TABLE, dbName=default, tableName=table_2a0111dbc5c34f6e9adeaff86b2c2769, message={"server":"","servicePrincipal":"","db":"default","table":"table_2a0111dbc5c34f6e9adeaff86b2c2769","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2a0111dbc5c34f6e9adeaff86b2c2769\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790582178},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/warehouse/table_2a0111dbc5c34f6e9adeaff86b2c2769\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2a0111dbc5c34f6e9adeaff86b2c2769\",\"kudu.table_id\":\"0485a22c767b4bcf9cf4424064408d18\",\"transient_lastDdlTime\":\"1790582178\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205\",\"kudu.cluster_id\":\"9ec5f5a0ebfb4a28993124d3fd7060b5\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790582187}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=52, eventTime=1790582187, eventType=CREATE_TABLE, dbName=default, tableName=table_34c72cbfe84d4e0397aee47a3f75b67a, message={"server":"","servicePrincipal":"","db":"default","table":"table_34c72cbfe84d4e0397aee47a3f75b67a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34c72cbfe84d4e0397aee47a3f75b67a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790582186},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task47VKlj/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790582125541271-27511-0/minicluster-data/warehouse/table_34c72cbfe84d4e0397aee47a3f75b67a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34c72cbfe84d4e0397aee47a3f75b67a\",\"kudu.table_id\":\"314da4c670c14fba843c4688089189c5\",\"transient_lastDdlTime\":\"1790582186\",\"comment\":\"\",\"kudu.master_addresses\":\"127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9ec5f5a0ebfb4a28993124d3fd7060b5\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790582187,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f6eca3b4920 google::LogMessage::Flush() at ??:0
@ 0x7f6eca3b468f google::LogMessage::~LogMessage() at ??:0
@ 0x7f6ed554735c kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f6ed5546b1c kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f6ed554ab92 kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f6ed554ab4a _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
@ 0x7f6ed554aada std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
@ 0x7f6ed554aaa2 std::__1::__function::__alloc_func<>::operator()() at ??:0
@ 0x7f6ed5549d9e std::__1::__function::__func<>::operator()() at ??:0
@ 0x5bd4e5 std::__1::__function::__value_func<>::operator()() at ??:?
@ 0x5bd31a std::__1::function<>::operator()() at ??:?
@ 0x7f6ecc5aa81b kudu::Thread::SuperviseThread() at ??:0
@ 0x4569a0 __tsan_thread_start_func at ??:?
@ 0x7f6ecdd0b6db start_thread at ??:0
@ 0x7f6ec905661f clone at ??:0
W20260928 07:56:47.368734 28556 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.221.254:36357)
W20260928 07:56:47.371955 28286 connection.cc:573] client connection to 127.26.221.254:36357 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 07:56:47.373659 28434 connection.cc:573] client connection to 127.26.221.254:36357 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 07:56:47.382402 29938 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:47.382936 29938 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:47.393951 29938 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:47.401678 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:47.402169 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:56:47.402606 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:47.405364 29938 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:56:47.445349 28255 heartbeater.cc:499] Master 127.26.221.254:36357 was elected leader, sending a full tablet report...
W20260928 07:56:47.938961 28540 debug-util.cc:398] Leaking SignalData structure 0x7b080007f460 after lost signal to thread 28409
W20260928 07:56:47.939985 28540 debug-util.cc:398] Leaking SignalData structure 0x7b080013a3e0 after lost signal to thread 28543
I20260928 07:56:48.144878 29948 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:48.145991 29948 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:48.148852 29948 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:48.168121 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:48.179797 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:56:48.180306 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:48.184274 29948 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:56:48.715090 29953 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:48.715502 29953 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:48.717059 29953 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:48.720014 27891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260928 07:56:48.723275 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:56:48.723694 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:56:48.724023 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:48.724550 29953 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:56:49.444202 28540 debug-util.cc:398] Leaking SignalData structure 0x7b0800107700 after lost signal to thread 28409
W20260928 07:56:49.445155 28540 debug-util.cc:398] Leaking SignalData structure 0x7b0800117c40 after lost signal to thread 28543
I20260928 07:56:49.718693 29959 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:49.719147 29959 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:49.720726 29959 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:49.725632 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:56:49.726167 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:56:49.726496 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:49.726972 29959 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:56:50.706163 29964 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:50.706705 29964 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:50.708935 29964 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:50.715914 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:50.720376 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:56:50.720652 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:50.721201 29964 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:56:51.957002 28249 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1940 after lost signal to thread 28101
W20260928 07:56:51.958622 28249 debug-util.cc:398] Leaking SignalData structure 0x7b0800112e80 after lost signal to thread 28252
I20260928 07:56:54.456902 29983 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:54.457370 29983 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:54.458942 29983 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:54.461323 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260928 07:56:54.464454 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:56:54.464846 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:56:54.465210 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:54.465888 29983 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:56:57.307104 30003 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:56:57.307770 30003 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:56:57.309926 30003 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:56:57.315941 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:56:57.316514 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:56:57.316865 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:56:57.317561 30003 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:56:57.546741 28255 heartbeater.cc:646] Failed to heartbeat to 127.26.221.254:36357 (20 consecutive failures): Network error: Failed to ping master at 127.26.221.254:36357: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:56:57.701056 28397 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (58 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:56:57.874071 28544 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (57 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:57:04.890173 30026 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:04.890698 30026 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:04.892371 30026 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:04.894790 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 07:57:04.897727 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:57:04.898159 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:57:04.898501 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:04.899084 30026 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:57:10.098253 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000814c0 after lost signal to thread 27869
W20260928 07:57:10.098968 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000a9da0 after lost signal to thread 27938
W20260928 07:57:11.442371 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000418e0 after lost signal to thread 27869
W20260928 07:57:11.442940 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0a20 after lost signal to thread 27938
I20260928 07:57:15.871722 30049 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:15.872409 30049 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:15.874428 30049 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:15.877147 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:57:15.880832 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:57:15.881392 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:57:15.881702 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:15.882311 30049 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:57:22.781531 30096 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:22.781924 30096 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:22.783588 30096 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:22.785775 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:57:22.789104 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:57:22.789577 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:57:22.789947 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:22.790630 30096 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:57:24.382177 30112 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:24.382658 30112 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:24.384238 30112 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:24.389645 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:57:24.390159 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:57:24.390518 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:24.391038 30112 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:57:34.518712 30166 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:34.519402 30166 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:34.521401 30166 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:34.524510 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 07:57:34.528746 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:57:34.529358 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:57:34.529752 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:34.530496 30166 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:57:37.332933 30186 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:37.333724 30186 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:37.338680 30186 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:37.342716 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:57:37.343307 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:57:37.343613 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:37.344226 30186 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:57:39.376528 30195 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:39.377077 30195 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:39.379029 30195 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:39.384676 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:57:39.385358 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:57:39.385720 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:39.386404 30195 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:57:47.147259 30221 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:47.147909 30221 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:47.150104 30221 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:47.171502 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260928 07:57:47.176077 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:57:47.176865 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:57:47.177320 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:47.178417 30221 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:57:48.892567 27893 maintenance_manager.cc:419] P f95afb2252e047ff9f5427a1cd7c0df0: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033347
I20260928 07:57:49.035668 27892 maintenance_manager.cc:643] P f95afb2252e047ff9f5427a1cd7c0df0: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.142s user 0.095s sys 0.024s Metrics: {"bytes_written":53199,"cfile_init":1,"dirs.queue_time_us":1455,"dirs.run_cpu_time_us":356,"dirs.run_wall_time_us":1234,"drs_written":1,"lbm_read_time_us":290,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2381,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":142,"thread_start_us":1750,"threads_started":2,"wal-append.queue_time_us":954}
I20260928 07:57:49.038636 27893 maintenance_manager.cc:419] P f95afb2252e047ff9f5427a1cd7c0df0: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10808 bytes on disk
I20260928 07:57:49.040583 27892 maintenance_manager.cc:643] P f95afb2252e047ff9f5427a1cd7c0df0: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":273,"lbm_reads_lt_1ms":4}
I20260928 07:57:51.374653 30243 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:51.375118 30243 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:51.376941 30243 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:51.382329 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:57:51.382892 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:57:51.383275 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:51.383831 30243 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:57:57.748109 28399 heartbeater.cc:646] Failed to heartbeat to 127.26.221.254:36357 (140 consecutive failures): Network error: Failed to ping master at 127.26.221.254:36357: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:57:57.967334 28255 heartbeater.cc:646] Failed to heartbeat to 127.26.221.254:36357 (140 consecutive failures): Network error: Failed to ping master at 127.26.221.254:36357: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:57:58.191210 28544 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (177 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:57:58.847205 30290 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:57:58.847859 30290 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:57:58.849849 30290 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:57:58.852319 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 07:57:58.856585 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:57:58.857131 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:57:58.857498 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:57:58.858116 30290 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:58:15.530496 28393 debug-util.cc:398] Leaking SignalData structure 0x7b08000dfca0 after lost signal to thread 28265
W20260928 07:58:15.532410 28393 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6820 after lost signal to thread 28396
I20260928 07:58:16.231177 30366 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:58:16.231894 30366 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:58:16.234992 30366 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:58:16.237841 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:58:16.241627 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:58:16.242161 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:58:16.242573 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:58:16.243319 30366 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:58:34.336272 30469 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:58:34.336813 30469 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:58:34.339449 30469 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:58:34.342324 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:58:34.346035 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:58:34.346606 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:58:34.346933 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:58:34.347606 30469 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:58:42.795117 28540 debug-util.cc:398] Leaking SignalData structure 0x7b08000f97c0 after lost signal to thread 28409
W20260928 07:58:42.796370 28540 debug-util.cc:398] Leaking SignalData structure 0x7b08001385c0 after lost signal to thread 28543
I20260928 07:58:43.062868 30524 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:58:43.063683 30524 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:58:43.066041 30524 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:58:43.073148 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:58:43.076721 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:58:43.077389 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:58:43.077721 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:58:43.078349 30524 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:58:47.587927 30557 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:58:47.588629 30557 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:58:47.590503 30557 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:58:47.596776 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:58:47.597590 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:58:47.597980 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:58:47.598767 30557 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:58:49.234071 28249 debug-util.cc:398] Leaking SignalData structure 0x7b080006db00 after lost signal to thread 28101
W20260928 07:58:49.235170 28249 debug-util.cc:398] Leaking SignalData structure 0x7b08000d79a0 after lost signal to thread 28252
I20260928 07:58:51.737650 30581 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:58:51.738173 30581 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:58:51.740341 30581 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:58:51.742733 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 07:58:51.746018 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:58:51.746434 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:58:51.746963 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:58:51.747668 30581 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:58:56.237103 27935 debug-util.cc:398] Leaking SignalData structure 0x7b080005ade0 after lost signal to thread 27869
W20260928 07:58:56.238163 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000c09a0 after lost signal to thread 27938
W20260928 07:58:57.820240 28397 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (297 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:58:58.448499 28253 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (298 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:58:58.493781 28544 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (297 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:59:03.115195 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4220 after lost signal to thread 27869
W20260928 07:59:03.115887 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000be1c0 after lost signal to thread 27938
I20260928 07:59:04.674391 30698 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:59:04.675168 30698 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:59:04.678401 30698 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:59:04.681155 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:59:04.685418 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:59:04.686295 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:59:04.686627 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:59:04.687281 30698 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:59:07.885530 30724 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:59:07.886157 30724 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:59:07.888059 30724 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:59:07.894634 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:59:07.895272 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:59:07.895594 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:59:07.896193 30724 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:59:10.749545 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000b62e0 after lost signal to thread 27869
W20260928 07:59:10.750123 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9980 after lost signal to thread 27938
W20260928 07:59:18.607260 28393 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa560 after lost signal to thread 28265
W20260928 07:59:18.608349 28393 debug-util.cc:398] Leaking SignalData structure 0x7b080007fa40 after lost signal to thread 28396
I20260928 07:59:21.406512 30828 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:59:21.407140 30828 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:59:21.408838 30828 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:59:21.411599 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 07:59:21.415182 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:59:21.415755 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:59:21.416105 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:59:21.416721 30828 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 07:59:33.842267 30906 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:59:33.842950 30906 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:59:33.844640 30906 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:59:33.851325 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:59:33.854688 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:59:33.855225 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:59:33.855620 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:59:33.856362 30906 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:59:35.340730 28249 debug-util.cc:398] Leaking SignalData structure 0x7b08000d80c0 after lost signal to thread 28101
W20260928 07:59:35.342087 28249 debug-util.cc:398] Leaking SignalData structure 0x7b08000ec7e0 after lost signal to thread 28252
W20260928 07:59:44.727224 28540 debug-util.cc:398] Leaking SignalData structure 0x7b080013ac20 after lost signal to thread 28409
W20260928 07:59:44.728379 28540 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb040 after lost signal to thread 28543
I20260928 07:59:49.489475 31053 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:59:49.490078 31053 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:59:49.492408 31053 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:59:49.495250 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:59:49.498517 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:59:49.499063 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 07:59:49.499431 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:59:49.500056 31053 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:59:57.304186 28540 debug-util.cc:398] Leaking SignalData structure 0x7b080010c260 after lost signal to thread 28409
W20260928 07:59:57.305871 28540 debug-util.cc:398] Leaking SignalData structure 0x7b0800110e00 after lost signal to thread 28543
I20260928 07:59:57.313827 31128 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 07:59:57.314558 31128 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 07:59:57.316668 31128 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 07:59:57.319690 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 07:59:57.323807 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:59:57.324440 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 07:59:57.324740 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 07:59:57.325354 31128 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 07:59:58.015552 28399 heartbeater.cc:646] Failed to heartbeat to 127.26.221.254:36357 (379 consecutive failures): Network error: Failed to ping master at 127.26.221.254:36357: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 07:59:58.808786 28544 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (417 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 07:59:58.882136 28253 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (418 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 08:00:16.214862 31289 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 08:00:16.215736 31289 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 08:00:16.219434 31289 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 08:00:16.224973 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 08:00:16.229678 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 08:00:16.230402 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 08:00:16.230801 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 08:00:16.231496 31289 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 08:00:30.088162 27935 debug-util.cc:398] Leaking SignalData structure 0x7b08000aab40 after lost signal to thread 27869
W20260928 08:00:30.088810 27935 debug-util.cc:398] Leaking SignalData structure 0x7b080007ec40 after lost signal to thread 27938
I20260928 08:00:34.791738 31451 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 08:00:34.792295 31451 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 08:00:34.794526 31451 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 08:00:34.797079 27891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 08:00:34.800534 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 08:00:34.801302 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 08:00:34.801622 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 08:00:34.802202 31451 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 08:00:48.206017 31562 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 08:00:48.206596 31562 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 08:00:48.208529 31562 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 08:00:48.211566 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 08:00:48.214946 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 08:00:48.215411 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 08:00:48.215709 27890 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 08:00:48.216288 31562 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 08:00:52.036470 28141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.221.195:44497, user_credentials={real_user=slave}} blocked reactor thread for 72551.9us
W20260928 08:00:52.850042 28393 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd740 after lost signal to thread 28265
W20260928 08:00:52.851085 28393 debug-util.cc:398] Leaking SignalData structure 0x7b0800124ec0 after lost signal to thread 28396
W20260928 08:00:58.094901 28397 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (536 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 08:00:59.114904 28544 heartbeater.cc:646] Failed to heartbeat to 127.26.221.252:41205 (537 consecutive failures): Network error: Failed to ping master at 127.26.221.252:41205: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
W20260928 08:00:59.338661 28255 heartbeater.cc:646] Failed to heartbeat to 127.26.221.254:36357 (500 consecutive failures): Network error: Failed to ping master at 127.26.221.254:36357: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
I20260928 08:01:02.878324 31691 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 08:01:02.878948 31691 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 08:01:02.881114 31691 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 08:01:02.883908 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 08:01:02.891242 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 08:01:02.892383 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 08:01:02.892709 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 08:01:02.893426 31691 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 08:01:14.308452 31777 raft_consensus.cc:493] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dfb6604d9ebb423090c878c2b1db0cab)
I20260928 08:01:14.309206 31777 raft_consensus.cc:515] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfb6604d9ebb423090c878c2b1db0cab" member_type: VOTER last_known_addr { host: "127.26.221.254" port: 36357 } } peers { permanent_uuid: "f95afb2252e047ff9f5427a1cd7c0df0" member_type: VOTER last_known_addr { host: "127.26.221.253" port: 45305 } } peers { permanent_uuid: "b64b51f6f084474eb360161ac99f9b16" member_type: VOTER last_known_addr { host: "127.26.221.252" port: 41205 } }
I20260928 08:01:14.311642 31777 leader_election.cc:290] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357), b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205)
W20260928 08:01:14.314173 27890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 08:01:14.317862 27890 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dfb6604d9ebb423090c878c2b1db0cab (127.26.221.254:36357): Network error: Client connection negotiation failed: client connection to 127.26.221.254:36357: connect: Connection refused (error 111)
W20260928 08:01:14.318387 27891 leader_election.cc:336] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b64b51f6f084474eb360161ac99f9b16 (127.26.221.252:41205): Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
I20260928 08:01:14.318667 27891 leader_election.cc:304] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f95afb2252e047ff9f5427a1cd7c0df0; no voters: b64b51f6f084474eb360161ac99f9b16, dfb6604d9ebb423090c878c2b1db0cab
I20260928 08:01:14.319198 31777 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f95afb2252e047ff9f5427a1cd7c0df0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260928 08:01:21.199697 28557 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205, num_attempts: 733) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
F20260928 08:01:21.217471 28562 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e54258c46322425fad34e060fa60546a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.26.221.254:36357,127.26.221.253:45305,127.26.221.252:41205, num_attempts: 733) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.26.221.252:41205: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20260928 08:01:21.217881 28556 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.221.254:36357)
*** Aborted at 1790582481 (unix time) try "date -d @1790582481" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800006b77) received by PID 27511 (TID 0x7fe7cb1fe700) from PID 27511; stack trace: ***
@ 0x2b0620 __tsan::CallUserSignalHandler() at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x2b2b03 rtl_sigaction() at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
@ 0x7fe7dcb31980 (unknown) at ??:0
@ 0x7fe7d7cdbe87 gsignal at ??:0
@ 0x7fe7d7cdd7f1 abort at ??:0
@ 0x2b6416 __interceptor_abort at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
@ 0x7fe7dad79d74 google::LogMessage::SendToLog() at ??:0
@ 0x7fe7dad7a920 google::LogMessage::Flush() at ??:0
@ 0x7fe7dad7fa5b google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x35e444 kudu::MasterStressTest::CreateTableThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:?
@ 0x38bc3e _ZNSt3__18__invokeIMN4kudu16MasterStressTestEFvvEPNS1_26MasterStressTest_Test_TestEJEvEEDTcldsdeclsr3std3__1E7forwardIT0_Efp0_Efp_spclsr3std3__1E7forwardIT1_Efp1_EEEOT_OS7_DpOS8_ at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/installed/tsan/include/c++/v1/type_traits:3846
@ 0x38baf1 _ZNSt3__116__thread_executeINS_10unique_ptrINS_15__thread_structENS_14default_deleteIS2_EEEEMN4kudu16MasterStressTestEFvvEJPNS6_26MasterStressTest_Test_TestEEJLm2EEEEvRNS_5tupleIJT_T0_DpT1_EEENS_15__tuple_indicesIJXspT2_EEEE at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/installed/tsan/include/c++/v1/thread:281
@ 0x38b23b std::__1::__thread_proxy<>() at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/installed/tsan/include/c++/v1/thread:?
@ 0x2b04e0 __tsan_thread_start_func at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:959
@ 0x7fe7dcb266db start_thread at ??:0
@ 0x7fe7d7dbe61f clone at ??:0